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In many circumstances a telephone call can be completed through a con- 
necting network in several ways. Hence, there naturally arise problems of 
optimal routing, that is, of making the choices of routes so as to achieve 
extrema of one or more measures of system performance, such as the loss 
(probability of blocking) or the carried load. 

As is customary in traffic theory, a Markov process is used to describe 
network operation with complete information. The controlled system is de- 
scribed by linear differential equations with the control functions (expressing 
the routing method, being used) among the coefficients. Restricting attention 
to asymptotic behavior leads to a problem of maximizing a bilinear form 
subject to a linear equality constraint whose matrix is itself constrained to 
lie in a given convex set. An alternative approach first shows that minimiz- 
ing the loss, and maximizing the fraction of events that are successful at- 
tempts to place a call, are equivalent. This fact permits a dynamic program- 
ming formulation, which, in turn, leads to a very large linear programming 
problem. Two small examples are treated numerically by this method. 

It is particularly important to try to verbalize, and then mechanize, the 
optimal routing strategies. In this endeavor, the linear programming formu- 
lation is of limited usefulness. Therefore, in the latter half of the work we 
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have attempted to use the special combinatorial structure imposed by the 
telephonic origins of the problem to shed light on the character of the optimal 
strategies. In particular, we show that for connecting networks with suitable 
combinatorial properties, the optimal route choices can be very simply de- 
scribed. Some of the remits obtained were suggested by, and verify, conjec- 
tures from the practical lore of telephone routing. 

The problem of routing calls falls into two parts: Which attempted calls 
should be accepted in which states? What route shoidd an accepted call use? 
The first problem is very hard, and only sample numerical answers for small 
networks are obtained. We solve the second problem analytically for a large 
class of cases by appeal to combinatorial structure in the network. These 
cases can be described roughly as those in which the relative merit of states 
(as far as blocking is concerned) is consistent or continuous; i.e., if a state 
x is "better" than another y, then the neighbors of x are in the same sense 
"better" than the corresponding neighbors of y. An abundance of examples 
indicates that these cases are numerous and so warrant attention. In a net- 
work with this kind of combinatorial property, a policy which rejects no 
unblocked calls and minimizes the number of additional calls that are blocked 
by completing an attempted call differs from an optimal policy only in that 
the latter may reject some calls. 

I. INTRODUCTION 

A telephone connecting network invariably provides many paths on 
which a particular telephone call can be completed. One of the operational 
problems faced by the control unit of a telephone system is then to as- 
sign to each accepted and completable call a path and, in particular, to 
choose these assigned paths in the best way. This is the problem of opti- 
mal routing of telephone calls. Thus, in the theory of telephone traffic 
there naturally arise mathematical problems of optimal routing, that is, 
of making choices of routes in probabilistic models for operating net- 
works so as to achieve extrema of well-defined measures of system per- 
formance, such as the probability of blocking (loss). 

Unfortunately, it is not unfair to state that the voluminous probabilis- 
tic theory of telephone traffic, now some sixty years old, still has rather 
little to say about how routes for calls should be chosen. We are speaking 
here of the mathematical theory of traffic. Naturally, a wealth of useful 
information about routing has accumulated over the years from experi- 
ence in the telephone field ; recently it has been buttressed and extended 
by many simulation studies. This information, nevertheless, still lies 
largely outside the province of the existing theory of telephone traffic. 

It is the aim of this work to formulate, study, and (in part) solve a 
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general class of optimal routing problems for telephone networks. The 
formulation of these problems is undertaken insofar as possible within 
the classical dynamical theory of telephone traffic initiated by A. K. 
Erlang, that is, in terms of Markov processes based on the assumptions 
of (i) negative exponential distributions for mutually independent hold- 
ing-times, and (m) randomly originating traffic. To these assumptions fe 
added a description of how attempted calls are accepted and assigned 
routes. 

We conclude this introduction with a brief summary of the entire 
paper. A complete summary appears later (Section IX) after concepts 
for formulating the problem have been discussed. As is customary in 
telephone traffic theory, we use a Markov process to describe the opera- 
tion of the connecting network under study. The Kolmogorov equations 
for this process then constitute a set of linear differential equations de- 
scribing the controlled system; in these the control functions expressing 
the routing method being used appear among the coefficients. It is nat- 
ural to restrict attention to asymptotic behavior; this leads to a problem 
of maximizing a bilinear (or linear fractional) form subject to linear 
constraints; this problem is equivalent to a linear programming problem. 
An alternative approach first shows that minimizing the probability of 
loss, and maximizing the fraction of events that are successful call at- 
tempts, are equivalent. This fact permits a classical dynamic program- 
ming approach. The remainder of the paper attempts to use this ap- 
proach to establish relations between combinatorial properties of the 
network and the policy(ies) optimal for given criteria of performance. 
In particular, it is shown that for connecting networks having certain 
"monotone" properties, optimal policies for minimizing loss correspond 
closely to the heuristic advice, "Prefer those states in which as few calls 
are blocked as possible". 

II. INFORMATION FOR ROUTING DECISIONS 

The problem of choosing "good" routes for information flow in a com- 
munications network is vastly complicated by the difficult questions 
surrounding the collection, updating, and relevance of information 
(about the state of the system) on the basis of which routing decisions 
are to be made. Thus, one of the items to be chosen in designing a rout- 
ing scheme is the information on which the routing is to be based. In- 
deed there is a whole spectrum of possible choices for this information, 
from no information at all (except what is unwittingly discovered in 
making call attempts), to full knowledge of the state of the connecting 
network. Clearly, a practical compromise between total ignorance and a 
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very expensive, complex scheme based on many data must usually be 
made. 

Our considerations in this work will be limited to the case of perfect 
information, in which the microscopic state of the connecting network is 
assumed known and available for making routing decisions. This case is, 
of course, very far from realistic : few existing or envisaged systems utilize 
even a small fraction of this possible information for routing. Indeed, 
much of it is likely to be of very little relevance. Nevertheless, it is im- 
portant to know what would be good routing if we could implement it 
and could afford it, so the full information case to be considered here 
forms at worst a limiting situation for which some theory is available, 
and a natural starting point for investigation. 

III. ACCEPTANCE OR REJECTION OF UNBLOCKED CALLS 

In the present discussion of the involved problem of routing calls, one 
of the difficulties that arises deserves special mention. This difficulty is 
the problem of deciding whether to accept or reject attempted calls 
which are not blocked. 

At first sight, it might seem that no unblocked call attempt should 
ever be rejected. The natural argument for this view is that the whole 
point of a telephone system is to complete calls, and that by rejecting 
an attempt that could have been completed, the system only lowers its 
performance. Sensible as this argument sounds, it is unacceptable be- 
cause it turns out that whether rejection of an unblocked call improves 
or lowers performance depends on the index of performance, on the dis- 
tribution of traffic among the sources, on the "community of interest" 
aspects of the system, etc. If the probability of blocking is used as an 
index, the "bad" effect of adding a particular call in a given state of the 
system may be so great and so lasting that it is better to reject the call, 
and improve the chance of completing many later calls. 

To put the matter another way, the problem of routing with full in- 
formation seems at first to boil down to the question: "Which of the 
paths available for call c in state x should be used?" This form of the 
problem overlooks the possibility that perhaps the best thing to do when 
the state is x and c is attempted is not to complete c at all, but to reject 
it! In other words, it assumes that, naturally, c will be put up in state 
x if it is attempted in x and is not blocked. This assumption has always 
been made in previous applications of the model we use. 1 - 2 

Conceivably, then, it is better to reject a call c that is not blocked in a 
state x. Thus the problem of routing should be phrased: "Should a call 
c, free and not blocked in state x, be completed, and if so, by which 
route?" 
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It turns out that answering the first part of the question, as to which 
calls should be completed in which states, is often the hardest part of the 
problem. Examples can be given in which it is fairly easy to solve the 
route selection part of the problem, but for which the question of whether 
a call should go in or not is not settled. That this question has substantial 
practical import is apparent from the simulation studies carried out by 
J. H. Weber, 3 which clearly show how in trunking networks prohibition 
of circuitous routes (and thus rejection of certain unblocked calls) can 
improve system performance. 

J. H. Weber 4 has also remarked that the problem of deciding whether 
an unblocked call should be refused is closely related to the distinction 
between trunking networks, used in toll systems to interconnect towns 
and cities, and central office networks, used to interconnect trunks and 
customers' lines at a single location. An important combinatorial differ- 
ence between the two types of networks depends on whether all calls 
use the same number of links. This is usually the case in central office 
networks, but rarely true in trunk networks. One result suggested by 
this distinction would be that a call should always be put up when all 
calls use the same number of links, but that circuitous routes might be 
profitably disallowed otherwise. 

It appears then that network structure bears on the problem of what 
calls to accept. However, examples can be given which show that even 
when there is almost no network structure, other factors such as the dis- 
tribution of traffic and the "community of interest" can make rejection 
of some calls part of an optimal policy. 

For example, if two lines calling at rates Xi , X 2 , respectively, compete 
for one trunk, the probability of blocking is 

2X1X2 



Al T A2 T 2X1X2 



if no unblocked call is rejected. If the calls of the line calling at rate Xi 
are always rejected, the probability of blocking (with rejected calls in- 
cluded among the blocked) is 

X1X2 + Xi 



Xi + X2 + X1X2 



(We have assumed that all calls have unit mean holding-time.) It fol- 
lows here that if 



X2" > Xi H- A2 T X1X2 



then it is better to reject all Xi calls than to put them all in! This exam- 
ple, although somewhat unrealistic, illustrates how the distribution of 
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traffic affects the rejection problem, even in the absence of network struc- 
ture. 

For an example involving the "community of interest", consider two 
disjoint sets of (n + 1) lines communicating over one trunk, with the 
quirk that each set has a distinguished line which only attempts calls to 
the distinguished line in the other set, while the other n lines of one set 
only attempt calls to the n nondistinguished lines of the other set. Let 
c be the call consisting of the two distinguished lines talking to each 
other. If c is always rejected, the probability of blocking is 

1 + \n(n - l) 2 
n 2 + Xn 2 (ra - l) 2 ' 

where we have assumed that lines which call each other do so at rate X, 
and holding-times have unit mean. If c is always accepted when it is not 
blocked, then the probability of blocking is 

2\n + Xn(n - l) 2 



2Xw 2 + 1 + ?i 2 + Xw 2 (w - 1) ! 



From these formulas it follows that it is better to reject c entirely if n is 
large enough, or if X is large enough, while if X is small enough it is better 
always to accept c. 

IV. STATES, EVENTS, AND ASSIGNMENTS 

The elements of the mathematical model to be used for our study of 
routing separate naturally into combinatorial ones and probabilistic. 
The former arise from the structure of the connecting network and from 
the ways in which calls can be put up in it ; the latter represent assump- 
tions about the random traffic the network is to carry. The combinatorial 
and structural aspects are discussed in this section; terminology and 
notation for them are introduced. The probabilistic aspects are con- 
sidered in a later section. 

A connecting network v is a quadruple v = (G,I,ti,S), where G is a 
graph depicting network structure, I is the set of nodes of G which are 
inlets, fi is the set of nodes of G that are outlets, and S is the set of per- 
mitted states. Variables x,y,z at the end of the alphabet denote states, 
while u and v (respectively) denote a typical inlet and a typical outlet. 
A state x can be thought of as a set of disjoint chains on G, each chain 
joining I to fi. Not every such set of chains represents a state: sets with 
wastefully circuitous chains may be excluded from S. It is possible that 
7 = S2, that I fl £2 = = null set, or that some intermediate condition 
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obtain, depending on the "community of interest" aspects of the net- 
work v. 

The set S of states is partially ordered by inclusion ^ , where x ^ y 
means that state x can be obtained from state y by removing zero or 
more calls. If x and y satisfy the same assignment of inlets to outlets, 
i.e., are such that all and only those inlets u £ I are connected in x 
to outlets u6 fi which are connected to the same v in y (though possi- 
bly by different routes), then we say that x and y are equivalent, written 
x ~ y. 

The set S of states determines another set £ of events, either hangups 
(terminations of calls), successes (successful call attempts), or blocked 
or rejected calls (unsuccessful call attempts). The occurrence of an event 
in a state may lead to a new state obtained by adding or removing a call 
in progress, or it may, if it is a blocked call or one that is rejected, lead 
to no change of state. Not every event can occur in every state : naturally, 
only those calls can hang up in a state which are in progress in that state, 
and only those inlet-outlet pairs can ask for a connection between them 
in a state that are idle in that state. The notation e is used for a (general) 
event, h for a hangup, and c for an attempted call. If e can occur in x we 
write e G x. A call c 6 x is blocked in a state x if there is no y £ S which 
covers x in the sense of the partial ordering S and in which c is in prog- 
ress. For h £ x, x — h is the state obtained from x by performing the 
hangup h. 

We denote by A x the set of states that are immediately above x in the 
partial ordering ^, and by B x the set of those that are immediately 
below. Thus, 

A x = {states accessible from x by adding a call} 

B x = { states accessible from x by a hangup} . 

For an event e 6 x, the set A ex is to consist of those states y ^ x to which 
the network might pass upon the occurrence of e in x. Thus, if e is a 
blocked call, A ex = \d\ ; also 

U A hx = B x 

hdx 

U A cx =A X . 

c not blocked in x 

The number of calls in progress in state x is denoted by | x |. The 
number of call attempts c £ x which are not blocked in x is denoted by 
s(x), for "successes in x." The functions j • | and s(- ) defined on S play 
important roles in the stochastic process to be used for studying routing. 
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It can be seen, further, that the set S of states is not merely partially 
ordered by ^ , but also forms a semilattice, or a partially ordered system 
with intersections, with z C\ y denned to be the state consisting of those 
calls and their respective routes which are common to both x and y. 
(See G. Birkhoff, 6 p. 18, ex. 1 and footnote 6.) 

An assignment is a specification of what inlets should be connected to 
what outlets. The set A of assignments can be represented as the set of 
all fixed-point-free correspondences from / to ft. The set A is partially 
ordered by inclusion, and there is a natural map y ( • ) : S — > A which 
takes each state x 6 S into the assignment it realizes; the map y(-) is 
a semilattice homomorphism of S into A, since 

x ^ y implies y(x) ^y(y), 

y(xC\y) ^y(x) C\y(y). 

V. ROUTING MATRICES 

It will be assumed throughout this work that attempted calls to busy 
terminals are rejected, and have no effect on the state of the network; 
similarly, blocked attempts to call an idle terminal are refused, with no 
change of state. Attempts to place a call are completed instantly with 
some choice of route, or are rejected, in accordance with some policy of 
routing. 

Two mathematical descriptions of how routes are assigned to calls 
will be used. The first, the routing matrix, is convenient for writing the 
Kolmogorov equations for the Markov processes representing network 
operation. The second, called a policy, affords a convenient notation for 
the actual determination of optimal routing methods for various net- 
works to be described in detail later. Either description is a rule or 
doctrine for routing. 

A routing matrix R = (r xy ),x,y 6 S, has the following properties: for 
each x £ S, let 11* be the partition of A x induced by the equivalence 
relation ~ of "having the same calls up," or satisfying the same assign- 
ment of inlets to outlets; then for each Y £ n* , r xy for y 6 Y is a possi- 
bly improper probability distribution over Y, (that is, it may not sum 
to unity over Y), 

r xx = s(x) - X) r xu , 

and r xy = in all other cases. 

The interpretation of the routing matrix R is to be this: any Y £ U x 
represents all the ways in which a particular call c not blocked in x 
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(between an inlet idle in x and an outlet idle in x) could be completed 
when the network is in state .r; for y € Y, r xy is the chance that if this 
call c is attempted in x, it will be completed by being routed through the 
network so as to take the system to state y. That is, we assume that if 
c is attempted in x, then with probability 

1 - E r xy (1) 

ve^cx 

it is rejected (even though it is not blocked), and with probability r xy 
it is completed by being assigned the route which would change the 
state x to y, for y £ A cx . The possibly improper distribution of proba- 
bility \r xy , y 6 Y} indicates how the calling rate X due to c is to be 
spread over the possible ways of putting up the call c, while the improper 
part (1 ) is just the chance that it is rejected outright. 

This description of routing matrices is a generalization of that used 
in Refs. 1 and 2 in that it permits, in the nonvanishing of (1), the rejec- 
tion of unblocked calls forbidden in the cited references. 

Thus, a routing matrix R is any function on S 2 with r xy ^ 0, r xy = 
unless y 6 A x oy y = x, and such that 

r xx = s(x) — E r xy 

U^A X 



and 



E r xy ^ 1, 

V£A ex 



for all c 6 x not blocked in x. A routing matrix corresponds to a fixed 
rule if r xy = or 1 for x ?± y; otherwise it corresponds to a randomized 
rule. The convex set of all possible routing matrices is denoted by C. 
A policy is a function <p: 8 X S — > S such that c,h £ x imply 

<p(c,x) £ A cx \J{x] 

<p(h,x) = x — h. 

It is apparent that a policy is equivalent to a fixed rule; the circumstance 
that <p(-,x) is defined also for hangups h is useful in the sequel. Varia- 
bles tp,ip are used to denote policies. 

The routing rules and doctrines that might be considered here are of 
course more numerous by far than those we have introduced above. 
In particular, time-dependent rules and history-dependent rules are 
natural generalizations. However, since we will be considering only time- 
invariant traffic and ergodic Markov processes as representations of 
operating networks, such generalizations add little of significance. 



1382 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1966 

An important point, however, is that the routing methods here con- 
sidered are based on a complete knowledge of the state of the system, 
i.e., we postulate that we are in the case of "perfect information." This 
postulate is grossly unrealistic for present day electromechanical tele- 
phone systems; for an electronic system with a very large and very 
cheap memory, it becomes realistic: the state of the network can ac- 
tually be stored and the routing rule in use represented by a giant trans- 
lator. Such a procedure overcomes the obvious impracticality of deter- 
mining the state by examination of the actual network, and is actually 
used in the Bell System's No. 1 ESS (Electronic Switching System). 6 

The routing matrices R used in Refs. 1 and 2 had the property that 
if a call is not blocked in a state, then it is completed in some way; only 
blocked attempts or attempts to busy terminals are rejected. Thus none 
of these rules for routing resembles the methods that are at present 
likely to be used in practice. However, since C contains rules that reject 
certain calls in certain states, even though these calls are not blocked, it 
turns out that a large class of routing rules which do mirror what might 
happen in practice is included in C. 

Some of the simplest routing rules are not based on any knowledge 
about the current state of the network. Given a call c that has been 
attempted, they provide a list of routes to be tried in order; the first 
route found available is used for the call. The list may include all possi- 
ble routes for c, or only some of them. It is easy to construct a routing 
matrix to represent such a rule. Let n , ri , • • • , r„ be the routes to be 
tried for a call c. For each state x in which c can occur, let r xy = 1 if 
use of the first r< that is available in x takes the system from x to y, 
and let r x „ = for all other y 6 A ex . If no route for c that is available 
in x is among ri , • • • , r„ , then c is rejected in x even though it may not 
be blocked, simply because the "sieve" for finding routes is too coarse. 

It was assumed in the previous paragraph that no information about 
the state was used. If it is known, e.g., in which element A of a parti- 
tion II of S the state currently is, a similar rule can be represented by a 
class of lists (of routes to be tried in order), one for each A 6 n. The 
same kind of construction then yields the appropriate R. Here the A 
such that xt € A is acting as the "information state." 

Thus, many R from C which reject certain calls in certain states de- 
scribe a rule which closely resembles what is done in practice, e.g., in 
the translator of the Bell System No. 4A crossbar switching system. 

VI. PROBABILISTIC ASSUMPTIONS AND STOCHASTIC PROCESSES 

A Markov stochastic process x t taking values on S is used as a mathe- 
matical description of an operating connecting network subject to random 
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traffic. It is assumed that this operation is in accordance with one of the 
routing matrices R of Section V. The rest of the process x t is based on 
two simple probabilistic assumptions: 

(i) Holding-times of calls are mutually independent variates, each 

with the negative exponential distribution of unit mean. 
(it) If u is an inlet idle in state x, and v t± u is any outlet, there is a 
(conditional ) probabilit y 

X/i + o(h), X > 

that u attempt a call to v in (t,t + h) if x t = x, as h —* 0. 

The choice of unit mean for the holding-times merely means that the 
mean holding-time is being used as the unit of time, so that only the 
traffic parameter X needs to be specified. 

It is convenient to collect these assumptions and the chosen routing 
matrix R into one transition rate matrix Q = (q xy ) characteristic of x t : 
this matrix is given by 





1 


if y e B x 




h- X y 


if y e A x 


-1*1 


- \[s(x) - 


■ fxx] if y = x 







otherwise. 



q*v = , (2) 



In terms of the transition rate matrix Q, it is possible to define an ergodic 
stationary Markov stochastic process [xt , t real) taking values on S. 
The matrix P(t) of transition probabilities 

P xu (t) = Pr{x t = y\xn = x\ 

satisfies the equations of Kolmogorov 

d T P(t) = QP(t) = P(t)Q, 0(0) = /, 
at 

and is given formally by the formula 

P(t) = exptQ. 

Since the zero state (the state with no calls in progress) is accessible 
from any state in a finite number of steps with positive probability, the 
process has only one ergodic class, and there exists a unique nonnega- 
tive row-vector 

V = {Px,x 6 S\ 
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such that as t — > °o 

Pit) 

and p satisfies the "statistical equilibrium" or stationarity condition 
p'Q = o, which can be written out in full in the simple form 

[la; I + \s(x) - \r zx ]p x = 5Z p u + X X) VvTv, x £ S. 

V£A X y£B z 

It is possible that a confusion arises in the mind of the reader as to 
whether we are talking about central office connecting networks or large 
trunk networks such as the toll system. For in telephone traffic theory 
these two areas of application are often described by different models: 
a "finite-source" model like the present one, in which the conditions of 
the inlets and outlets form a significant part of the state of the system, 
is commonly used for the former; an "infinite source" model, with groups 
of customer's lines reduced to Poisson sources of traffic, is frequently 
used for the latter. The reason for this difference is that it has simply 
turned out to be sufficient, in the toll case, to restrict attention to the 
trunking network as the object of principal interest, and to use the sim- 
pler Poisson description of sources. 

In principle, of course, the model to be used here serves to describe 
either area listed above, although in the toll case it naturally demands 
use of a very large number of states. Thus, in the sequel we make no at- 
tempt to distinguish the toll case from the central office case. This view- 
point is justified by the fact that the results to be obtained are robust 
under passage from finite- to infinite-source models, or they can be re- 
formulated and reproved in the infinite-source context. 

VII. FORMULATION OF THE ROUTING PROBLEM 

The most common figure of merit used by telephone traffic engineers 
for evaluating connecting networks is the probability of blocking, the 
fraction of call attempts that are blocked. It is natural, therefore, to use 
this quantity as the objective function in our optimization problem of 
routing. It has been shown 2 for the process x t to be studied here that if 
no unblocked call is rejected the probability of blocking (in the mnemonic 
form Pr{bl\) is given in terms of the stationary state probability vector 
p by the formula 

Pr\U) -« = ^, 
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where 

/3 X = number of idle inlet-outlet pairs that are blocked in state x, 

a x = number of idle inlet-outlet pairs in state x. 

By the same methods it follows that for a process x t denned in terms 
of an 7^ 6 C the fraction of attempted calls which are not completed 
(are "lost"), be it because they were blocked or simply rejected, is 
given by 

p'(fl + r) 
p'a 

where r = \r xx , x £ S] is the diagonal of the routing matrix R. 

We can now replace the informal problem of minimizing, by suitable 
routing, the fraction of call attempts that are lost by a precise problem 
of mathematical programming, as follows: Choose R £ C so as to achieve 

minP' (g , + r) 
pa 

subject to p Q — 0, p 1 = 1, and p ^ 0. (The '1' in 'p V is the vector 
with all components 1.) Of the constraints, the first is the equilibrium 
condition on p, the second states that the components of p sum to one, 
and the third says that p is nonnegative. It is understood, of course, 
that Q is to be related to R by (2) or, what is the same, by 

Q = H + \R - diag (| x | + \s(x) + 2\r xx ) = Q(R), 

where H = (h xy ) is the "hangup matrix" such that h xy = 1 or ac- 
cording as y 6 B x or not. 

Several authors have formulated routing problems for communica- 
tions systems. Many of these problems have dealt with systems of the 
store-and-forward type, in which information is alternately stored at 
and transmitted from a node in the network without setting up a "con- 
tinuous path" from source to destination. Such formulations are inap- 
plicable to telephone systems. A possible exception, though, is that 7 
of R. Kalaba and M. Juncosa which, for a given amount of traffic be- 
tween each specified source and destination, and a given network having 
capacity constraints, attempts to find continuous routes that are best 
in the sense of maximizing the delivered traffic by solving a linear pro- 
gramming problem. 

In its possible application to telephony, this model envisions a given 
traffic pattern (i.e., a description of who wants to talk to whom) to be 
satisfied at a particular moment, and tries to find a way of routing as 
much of this traffic as possible through the network. In our terminology, 
a traffic pattern is an assignment a(-), and satisfying it means finding 
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an x 6 S such that y(x) = a. The amount of traffic carried is simply 
the number | x | of calls in progress. Of course, it is not always possible 
to satisfy an assignment. Thus, Kalaba's and Juncosa's formulation 
translates into our setup as follows: Given an assignment a(-) either 
find x € S with 7 (x ) = a, or else if a ( • ) is unrealizable, find x £ S 
which realizes as much of a(- ) as possible, i.e., such that 7 (x) ^ a and 
I x I is a maximum. This can be rephrased as follows: If a(- ) is given, 
form the cone 

K = K(a) = {ai : ai ^ a], 

and within y" 1 (K) pick a state x that is maximal in that | x | ^ \y \ 
for each y 6 y -1 (K). 

It is to be emphasized that this problem is markedly different from 
our form of the routing problem. The former is purely combinatorial in 
character. There is no parameter such as the traffic X per inlet-outlet 
pair, so the problem involves no probability, and can have nothing to 
do with the "grade of service" as customarily employed by telephone 
engineers. Furthermore, the whole formulation overlooks the fact that 
in present systems call completions must be made without disturbing 
calls already in progress. 

VIII. PRINCIPLES OF ROUTING 

It is important to distinguish methods of routing from principles of 
routing. A method of routing is a specific way of accepting or rejecting 
attempted calls and choosing routes in a particular system, e.g., that 
implicit in the translator of the Bell System No. 4A crossbar switching 
system. A principle of routing is a kind of general prescription of what 
constitutes* "good" or "optimal" routing; it is the backbone of many 
routing methods that might be based on it. 

A principle of routing is particularly useful if it has two properties : 

(i) It is relatively simple and intuitive to state. 

(ii) There is a substantial class of systems for which it describes 
the (or part of the) optimal routing method. 

In our mathematical setting a method of routing corresponds roughly 
to a rule R £ C. We shall see that the "best" rule R £ C can be ob- 
tained by solving a linear programming problem. Now if it should hap- 
pen that for an interesting class of networks the solutions of these linear 
programs had some common characteristic, some combinatorial property 



Or, more usually, of what someone's intuition tells him constitutes. 
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of the sets of states of the networks that served as an alternate descrip- 
tion of the linear program solution, then this characteristic or property 
could be abstracted into a genuine principle of routing. 

Alternatively, one could formulate as conjectures some intuitive prin- 
ciples of routing, and then try to determine for what classes of networks 
(if any!) these principles did, in fact, describe the optimum routing 
methods. This second approach will be followed in the present work; the 
rest of this section is devoted to a discussion of some a priori reasonable 
candidates for "good" routing rules. All of these candidates are expres- 
sions of one and the same idea, namely, that one routing rule is better 
than another if it avoids more "bad" states, where a "bad" state x is 
one for which /3 X is high. This idea is not just an attractive first approxi- 
mation to "good" or even optimal routing; it leads at once to conjee tures 
for which our results later in the paper provide strong support in precise 
ways. 

In spite of the lack of general theoretical knowledge about routing, 
traffic engineers have developed various conjectures and intuitive ideas 
about what might constitute "good" methods for choosing routes. These 
conjectures are a natural starting place for any rigorous approach to 
routing, because the formulation of precise theoretical models in which 
routing can be studied at once raises the question, "Which of these 
methods, conjectured to be good, can be proved to be optimal in some 
theoretical model?" Since many of these methods are relatively simple 
to describe, and hence to mechanize, established answers to this question 
would have immediate practical applications. Some of these conjectures 
will now be discussed. 

It is apparent that in a telephone system, putting up a new call can 
only increase the number of idle pairs that are already blocked. Another 
way of saying this is that in giving service, i.e., in realizing an attempted 
call in a connecting network, one is possibly denying service to certain 
inlets and outlets presently idle, who might attempt a call in the very 
immediate future. This observation has given rise to a number of routing 
rules (for systems with blocked attempts refused) of great intuitive 
appeal, which can be described collectively by the admonition: To de- 
crease (minimize?) the probability of blocking, put in new calls in such 
a way as to minimize the additional congestion resulting from the new 
calls. 

It is illuminating to discuss particular forms of this advice. One form 
is this: Route new calls through the most heavily loaded part of the net- 
work that will accept them. Another is: Put in a given new call so as to 
minimize the chance that the next attempt to place a call be blocked. 
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Or: Avoid blocking states, that is, prefer states in which fewer idle 
pairs are blocked. 

For all the intuitive appeal possessed by these rules, rather little is 
known about them. Nevertheless, they provide conjectures that will be 
examined in the precise setting of our theoretical model to yield, we hope, 
the beginnings of a mathematical theory of optimal routing. Let us see 
what these rules enjoin in terms of our model. If we put up a call c so as 
to take the system to a state y, the chance that the next event is a blocked 
call attempt is 

ft, 



\y\ + *«» 

Suppose that we just left state x, so that y £ A cx . This probability will 
be smallest if y was chosen according to the "maximum s(-)" policy, 
that is, 

s(y) = max s{z), 

i.e., if we prefer states in which fewer idle pairs are blocked. Thus, in our 
model the second two forms of the above advice coincide. 

Another conjecture arises out of consideration of gradings in which 
calls overflowing certain primary routes are pooled and offered to over- 
flow circuits. Here a natural expectation is that one should always "fill 
the holes in the multiple," meaning by this that a primary route should 
be used whenever possible, so that the overflow is left available to as 
many lines as possible. It will be shown for certain examples that if calls 
are accepted unless they are blocked, then this rule both describes the 
optimum routing choices, and is equivalent to the "maximum s(-)" 
policy of the previous paragraph. 

IX. SUMMARY AND DISCUSSION 

In Sections I to VII the problem of routing calls in a telephone net- 
work has been formulated as a mathematical one within Erlang's basic 
traffic theory. Some routing rules which are intuitively reasonable can- 
didates for "good" or even optimal routing were described in Section 
VIII. 

Since the expansion of \p x , x 6 S\ such that p Q = 0, p > 0, is 
known, 1 ' 2 it is natural to start in Section X with a consideration of 
Pr{ bl] for low traffic : X — » 0. We have 

X 1 * 1 
Px = Po, — n ? "* + °( x ' x ')> X— >0, 
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where r x is the number of strictly ascending (in ^ ) paths from to a; 
which are permitted by R. If x is a blocking state it contributes a term 

»A_p,£!5A + fl (x'"), x^O 

pa | X | ! pa 

to Pr{bl\ if no calls are rejected. It follows that for sufficiently low traffic 
the policy that minimizes r x is optimal within the policies that reject no 
calls. In a similar way, it can be shown that always refusing a call c 
cannot be optimal for X sufficiently small, and that there is never any 
point in rejecting a call attempt in a state x with 

|.r| < min{|tf |: y £ S, ft > 0}, 

for X small enough. 

The nonlinear problem of choosing R to minimize Pr{bl] is reduced to 
a linear programming problem in Section XI. This reduction substan- 
tially facilitates obtaining numerical results, examples of which appear 
later in this summary. 

In an effort to identify optimal routing policies, attention now (Sec- 
tion XII) shifts away from the formal linear programming approach to 
the underlying Markov process. It is shown that minimizing Pr{ bl] , and 
maximizing the fraction of events which are successful call attempts, 
are equivalent; this fact leads to a direct dynamic programming ap- 
proach, in which 

min Pr{bl\ 

ft £C 

and 

lim ri~ l max E{ number of successful call attempts in n events} 

(with the maximum in the second expression over all possible policies 
for n events) are both achieved by essentially the same stationary policies. 
The word 'essentially' hides the inherent nonuniqueness of optimal 
policies due to symmetries in the network and to the possible presence 
of transient states. 

In Section XIII it is shown, following C. Derman, that minimum 
blocking is achieved by a fixed rule. 

The mathematical programming problems arising in this new approach 
are again of the linear programming type, and are similar to those arising 
in Section XI. Our principal interest, however, does not remain with 
calculating numerical solutions, but shifts abruptly to the relationships 
of these solutions to the combinatorial structure of the network. Thus, 
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the second half of this paper consists less of suitable programming prob- 
lems than of intuition and combinatorics applied to exhibit (in parte or 
in toto) the solutions of these problems and then dependence on and origin 
in network structure. 

The attempt to discover and characterize optimal policies in a whole- 
sale way by appeal to network combinatorics (rather than piecemeal by 
numerical calculation) begins in Sections XIV and XV with considera- 
tion of some simple examples; these lead to the introduction of some 
"monotone" properties (of connecting networks) which impose the con- 
dition that (roughly) the relative merit (as far as blocking is concerned) 
of states is consistent or continuous, i.e., that if a state x is "better" 
than another y, then the neighbors of x are in the same sense "better" 
than the corresponding neighbors of y. 

Consideration of these properties is justified by the facts that (i) 
they appear in the examples, and (ii) they yield a series of closely knit 
results (Theorems 7-15) that go far to bear out the heuristic guesses in 
Section VIII about the nature of good routing. In particular, in a net- 
work with one of the monotone properties, a policy which rejects no 
unblocked calls and minimizes the number of additional calls that are 
blocked by completing an attempted call differs from an optimal policy 
only in that the latter may reject some calls. In other words, the "max 
s(-)" policy is optimal to within rejection of calls. 

Each monotone property gives rise to a corresponding isotony theorem 
which gives a numerical expression to the relative merits of routes for 
calls that are implicit in the purely combinatorial monotone property. 
The relevance of these isotony theorems to optimal routing is explained 
heuristically in Section XVI. The theory culminates, in Section XVIII, 
with two optimal routing theorems based on the monotone properties. 
When one of these properties obtains, these results completely answer 
the question: Which route should be used for an accepted call when there 
is a choice of routes? Determining the extent to which these combina- 
torial properties occur in networks of interest appears to be the next 
major problem in any continuation of the present study. 

It is to be stressed that the monotone properties we introduce serve 
only to identify the route that a call should take if it is to be accepted; 
they do not in any way help to decide which calls should be accepted. 
Except for the low-traffic results of Section X, and the (obvious and 
easily proved) fact that in a nonblocking network no call should be re- 
jected, the problem of acceptance or rejection of calls remains an enigma. 
Some light on it is shed by the numerical results that immediately follow 
this summary. 
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The paper concludes in Appendix A with the remark that if the per- 
formance index is modified so as to put greater emphasis on "early 
blocked attempts", i.e., ones occurring soon after the system is started, 
then no calls should be rejected. The result is proved in detail for this 
index: the expected number of events until the first blocked attempt. 
Such a criterion corresponds to trying to avoid the undesirable event, the 
blocked call, as long as possible. 

We turn now to numerical results obtained by solving the linear pro- 
gramming formulation of Section XI for two simple networks. The first 
is the three-stage Clos network with 2X2 switches depicted in Figs. 1 
and 2, and already considered as an illustration of routing in Refs. 1 
and 2. The second is a 6-line to 4-trunk concentrator in which each line 
has access to 2 trunks; it is shown in Figs. 3 and 4. In this second case, 
the probabilistic model was modified to make X > the calling-rate per 
idle line, rather than that per idle inlet-outlet pair. 

In each example, both the minimal probability of blocking, and the 
probability of blocking under random routing, were calculated for several 
values of X by use of the LP90 program. To be more precise, two linear 
programming problems were solved for each example; the first deter- 
mined the optimal policy, the second determined the optimal policy 
among those policies which assigned random routes to accepted calls. 

Several important qualitative features of the optimal routing policy 
were the same in both examples and are described together in the follow- 
ing list: 

(?•) The optimal policy rejected no calls. 
(ii) The routes assigned by the optimal policy coincided with those 

that keep s( • ) as large as possible. 
(iii) The optimal policy was the same for all values of the traffic 

parameter X examined. 
(iv) The improvement over random routing brought about by optimal 

routing decreases as the traffic X increases. 




= 2X2 SWITCH 



Fig. 1 — 3-stage Clos network with 2X2 switches. 



1392 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1966 









X X 




nan 

nan 



Fig. 2 — States of 3-stage Clos network of Fig. 1. 

Under the constraint that accepted calls be routed at random the op- 
timal policy was again to accept all unblocked attempted calls. 

Results for the Clos network are given in Fig. 5 and Table I. It is ap- 
parent that for low X optimum routing gives a loss that is easily an order 
of magnitude less than that due to random routing. At high values of 
X the difference all but disappears. This behavior is explained in part by 
the fact that there is no blocking in the "upper" states of Fig. 2; when 
X is very large the system spends all its time in these states; when X is 
low, however, the occasion for a choice between states 2 and 4 often 
arises and a correct choice makes a significant difference. (At very low 
values of X the difference will again decrease because only state 1 will 
ever be visited with any frequency.) 

Results for the concentrator are shown in Fig. 6 and Table II. They 
include a numerical comparison with hand-calculated loss figures from 
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unpublished work of S. P. Lloyd dated circa 1953. At that time Lloyd 
studied this particular concentrator model, correctly guessed the optimal 
policy, proved its optimality for low X, and calculated the loss for some 
values of X. This example exhibits the behavior, conjectured in Ref. 2, 
p. 275, that a good (here, optimal) policy make certain "bad" states 
transient states. The state numbered 9 is such a transient state under the 
optimal policy found numerically by the linear programming method. 

The present study of routing in telephone networks has suggested a 
number of conclusions and conjectures: 

(i) The problem of optimal routing of calls in telephone connecting 
networks (with full information) can be formulated and solved 
with Erlang's classical theory of traffic. In this endeavor, the 
contrasting techniques of machine calculation and combinatorial 
analysis can be employed either as alternative methods or as 
complementary approaches. 

(ii) The problem separates into two parts, that of deciding which 
calls to accept, and that of choosing routes for accepted calls. 
Analytically, the first part appears to be much harder than the 
second, which frequently has a simple intuitive solution closely 
related to the structure of the network. 

(in) Posed within Erlang's theory, the routing problem can be reduced 
to a (usually very large) linear programming problem and at- 
tacked numerically, or studied in terms of Markov decision proc- 
esses and dynamic programming. 

(w) In an apparently wide class of connecting networks, certain 
natural monotone properties and some isotonies based on them 
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Fig. 3 — 6-to-4, 2 access concentrator. 
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EDGES = LINES 
VERTICES = TRUNKS 



ARROW POINTS TO 
TRUNK IN USE 



Fig. 4 — States of 6-to-4, 2 access concentrator. 



are the key to choosing optimal routes for accepted calls. The re- 
sulting optimal policies are remarkably easy to describe and to 
instrument; they agree fully with some of the conjectures de- 
veloped over years of practical experience in telephony; they are 
even robust under changes of performance index. Naturally, 
each example studied here involves a very small network. Never- 
theless, the fact that the monotone properties turned up in each 
of a substantial number of small networks of diverse structure 
suggests that they are also present in larger ones. Whether this is 
so is a topic for future research. In any case, the examples we 
offer indicate that the theory of routing here developed applies 
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equally well to central office networks and to various gradings 
and concentrators. 

(v) In the interesting area of low traffic, optimal routing can be as 
much as an order of magnitude better than random routing; 
with high traffic the advantage decreases rapidly. In all the ex- 
amples studied, the optimal routing policy was independent of 
the traffic X; this suggests that in most cases the optimal policy 
is basically a combinatorial feature of the network alone, and is 
probably optimal in many probabilistic models of network opera- 
tion. 

(vt) There are situations in which attempted calls should be rejected 
even though they are not blocked. Simple examples of this 
phenomenon all seem to be rather unnatural; but J. H. Weber* 
has discovered it numerically in trunking networks, and has sug- 
gested 4 that it is associated with unequal lengths of paths for 
calls. The examples we studied numerically in the present work 
did not show it; but they had the property that all paths for calls 
were of the same length. We conjecture that there is a large class 
of "regular, well-behaved, normal, etc." networks in which no 
optimal policy rejects an unblocked call, and that in general oc- 
casions on which such calls should be rejected are rare. Even if 
they occur in practical central office networks, these occasions 
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Fig. 5 — Pr\bl\ for Clos 3-stagc network with 2X2 switches. 
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Table I — Probability of Blocking for Clos 3-Stage 2X2 
Network for Optimal and Random Routing 





Pr[bl\ 




Optimal 


Random 


0.01 


0.00000181 


0.00018319 


0.05 


0.00015926 


0.00334468 


0.1 


0.00087324 


0.00960844 


0.2 


0.00376107 


0.02259477 


0.5 


0.01593861 


0.04807122 


1.0 


0.03146853 


0.06360424 


2.0 


0.04381783 


0.06670098 


3.0 


0.04584041 


0.06206897 


5.0 


0.04233249 


0.05152606 


10.0 


0.03115608 


0.03463135 


30.0 


0.01405820 


0.01459520 


50.0 


0.00901346 


0.00922144 


100.0 


0.00475109 


0.00480733 
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Fig. 6 — Pr[bl] for 6-to-4, 2 access concentrator for random and optimal routing. 
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Table II — Probability of Blocking for 6-to-4, 2 Access 
Concentrator for Optimal and Random Routing 





Optimal 














(S.P. Lloyd) 


(Author) 




0.1 


0.0049 


0.00536231 


0.00864729 


0.2 




0.02093718 


0.02972292 


0.4 


0.0716 


0.07170622 


0.08856109 


0.7 


0.1628 






1.0 


0.2478 


0.23154056 


0.24943320 


2.0 


0.4498 


0.44971622 


0.46141067 



probably should be taken seriously (by a company committed to 
giving service) only if they are demonstrably associated with 
large amounts of congestion or a near-breakdown in operation. 
Hence, finding optimal policies to within rejection of calls may be 
considered a "practical" solution of the routing problem originally 
posed. 



X. SOME COMPARISON THEOREMS FOR LOW TRAFFIC 

There are two ways in which a theoretical analysis can substantially 
further progress in the problem of routing: (i) by means of local compari- 
son theorems that establish that one method of routing is better than 
another, and (ii) by means of global optimality theorems that exhibit (in 
part or overall) one or more optimal policies which actually achieve the 
best possible value of the performance index in use. In this section, we 
prove some comparison theorems which are valid asymptotically as the 
traffic parameter approaches zero. At first, we restrict the analysis of the 
present section to the case 1 - 2 in which no unblocked call is rejected if it is 
attempted, so that we avoid the difficult question of deciding whether 
an attempted call that is not blocked should be completed or rejected. 

For a first glimmer of insight, we shall examine the formula 



Pr[bl) = 



p'a 



Q = Q(R), R a fixed rule 



valid when no unblocked call is rejected, in the very common situation 
in which there is an integer greater than zero, n say, such that there is 
no blocking in states with fewer than n calls in progress, and there are 
states with n calls in progress in which some calls are blocked. In this 
case it is known 1,2 that 
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p'a = p XI n II «i + o(X"), 



as 



X — * 0, where 1 ' 



r x = number of paths on S ascending from to x and permitted by R 



= (R w ) 



Vx 



= the 0,x entry of the | x |-th power of R, (4) 

and 

aj = number of idle inlet-outlet pairs in a state having j calls in 
progress. 

(We recall that for the important cases of one- or two-sided networks 
a x = a \ x \ = aj for all x with \x\ = j.) It follows from (3) that for 
small X the leading term is critical: the blocking will depend principally 
on how easy it is to reach a blocking state from the zero state, with this 
"ease" measured by the number 

E rxft = (#"/3)o 

\x\~n 

= the number of ways in which a blocked call can arise with- 
out having any hangups, starting at zero. 

If the matrix R is not fixed, but allows some random choices of route, 
then this quantity can still be viewed as the "expected number of ways 
in which a blocked call can arise without having any hangups, starting 
at zero." It is apparent that this number is given by /o , where the 
numbers {/* , | x \ ^ n) are defined by the nonlinear recurrence 



U = 



/3 X \x\ = n 

2 min /„ | x | < n. 

cgx V£A CX 

lot blocked in x 



Indeed we have the result : 
Lemma 1: 



E r,j8, ^ /o for R € C 

|x|-» 



Proof: Let R be given and let 
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p x I x | = n 

4-(v , ,1/ (5) 

2_ r xy dy \x\ < n. 

We prove the stronger result that d x ^ f x . It is clear that 
do = 2 »*flp , ^x = /x for | x | = n. 

If f/„ ^ /„ for [ y | = k + 1, then for | ;r | = A: 

^ 13 min /„ = f x . 

c iillc in x U*A cy 

c not blocked in x 

We shall say that R £ C puts # 6 S on an ascending path to a state 
z if and only if 3y , • ■ • , ft,| with 2/0 = 0, | */,• | = i, y\ z] = z, and r Wl+1 = 
1 for i = 0, • • • , I z I — 1, and x > is among yi , • ■ ■ , y\z\ . Let Z) 
be the subset of all fixed rules R € C such that if | 2 | = n, and if iffi 
puts x,y with ?/ € ij on an ascending path to z, then r xy — 1 only if, 
with c = y(y — x), 

f„ = min /„ . 

wc -*cx 

The numbers {f x , | x | ^ w} are the key to optimal routing for low values 
of X, or to put it more picturesquely, they are the key to staying as far 
away as possible from the blocking states in [x\ \ x \ = n\, which are 
the ones that provide the leading term in Pr{bl\ as X — ■* 0. We have 

Theorem 1: Let R € D and R £ C — D. Then for all X small enough 

Pr\U\ R < Pr{bl\ R *. 

Proof: Let d x * be defined in terms of R* according to (5) used in Lemma 
1 . Since R* £ D, there exist x,y,c, and e > 0, such that 

y £ A x , y(y - .c) = c, r xy * = 1 

/„ ^ min /, + e, (6) 

:€*cx 

and a maximal chain = 2/0,2/1,2/2, ■ ■ ■ , V\x\-i , y\ x \ = x ascending 
in ^ such that 

r Vi v i+ * = 1. * = 0, • • • , I x I — 1. 
Now, using d* ^ /, 
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d x * = E r x *d* 



2 6 -A* 

= E r x *d z *+f y 

*X-{V\ 

^ U + e, 

the last inequality a consequence of d* ^ / and the definition of /. Simi- 
larly, if d Vi+ * > f Vi+1 , then 

rf * — V r *d * 4- d * 

> /«*. 

Since y = 0, we have do > /o . 
Setting a = f , a* = d *, and 

n . k-n Jfe— 1 

6 = s -rr n «i i 

fc =0 K ! 3=0 

we have the asymptotic forms 

a + e 



Pr[blU = 
Pr{U}n* = 



b + 8 
a* + e* 



6+5* 

with £,8,£*,8* all o(l) as X — > 0, and a < a . Since 6 increases as X — ■» 

(a - a* + £ - £*)b < a*8 - a8* + £*8 - £8* 

for all X small enough. This is equivalent to 

ab + £b + a5* + eS* < a*6 + £*6 + a*8 + t*5, 

a + e a* + e* 
b~+~8 b + 5* ' 

and proves the theorem. 

Low traffic analyses of the kind just employed can also shed some 
fight on the problem of rejecting or accepting unblocked calls. For ex- 
ample, if a call c is always refused in every state, then 

r xx ^ 1 
and 
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p'(|8+r) ^ l + p'P 



Pr{bl} = 



p'oc p'a 



— » — as X — > . 

However, if no unblocked call is rejected, then Pr{bl] — > as X — > 0. 
Thus, always refusing c caiuiot be optimal if X is sufficiently small. 
For another example, suppose as before that 

n = min ( | y | : ft, > 0J > 0, 

and let c be a call which is refused by R in some state x with | x \ < n. 
It is easy to see that for the rule R 

Fr { oZ j ^ jx[] - 

a + o(X) 

On the other hand, if the rule Ri refuses no unblocked calls, 

p nn -,Z r, m fi,+ o(X") 
Fr{M] = n! [„!=* __ , 



«0 



o(X) 



where the superscript 1 indicates that Ri supplants R in (4). For X 
small enough, then 

T-T7 r x > — Lj r„ ft, 

\X\\ 7l\ | tf |- B 

and /?i is better than R. Thus, there is never any point in refusing an 
unblocked call attempt made in a state x whose norm or dimension is 
less than the minimum norm achieved by the blocking states, if X is 
small enough. 

XI. REDUCTIONS TO LINEAR PROGRAMMING PROBLEMS 

Our effort to choose, with full information about the state of the net- 
work, routes for new calls so as to minimize the probability of blocking 
has led, upon the assumption of a simple probabilistic description for the 
traffic, to this problem of mathematical programming: To minimize 

p'(fl + >•) (7) 

p'a 

subject to p ^ 0, p'\ = 1, p'Q = 0, Q = Q(R), R 6 C. 
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It is relatively easy to see that this problem can be formulated as one 
that has a bilinear (or linear fractional) objective function, and linear 
constraints. We change variables to U = (u xy ) and u CI defined by 



Uxy — Px'l'xy 


*,y € 


s, 


V € A, 


U cx = Px — £ U X y 

v£A C z 


c e 


x, 


A cx * e, 


Uxx = 2 

c not blocked in x 


Ucx- 







Conversely, we introduce p in terms of U by setting 

j— j E u yx if s(x) = 0, 



P^ = 



Uxx+ £ 



u. 



-p± if •(*) > 0. 

s(x) 



If c is a call which can be completed in state x, then A cx 9^ 0, and 

A Zl U X y 

V£A CX 

is the equilibrium rate at which c is completed in state x, and 



Xu cx = \p x — X E 






is the equilibrium rate at which c is rejected in state x. 

The transformation of variables from p to { U,u cx ) necessitates adding 
additional constraints if a sensible problem is to result. Evidently, for 
c (E x not blocked in x 

Px = U cx + £ «*» . 

The left-hand side does not depend on c. For different c € .r not blocked 
in .r all these formally different ways of calculating p x must agree, and 
it is, therefore, necessary to impose the additional constraint that 

c,c 6 y(A CI — x) = y\y: y = z — x for z £ A cx \ implies 

Ucx + £ Uxy = U c 'x + £ «*» • 

V£A e x K^c'i 

The condition p Q = then gives the condition, for s(.r) > 0, 
_B_ ( W» + £ O + £ Uxy = £ f ««, + 2 u,,A + X 2 «y* 

S(X') V »€^x / VtAx V&Az \ z€Ay / 1/6 Bi 
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to be satisfied by U. Naturally, the condition U ^ is imposed. We 
define R in terms of U by 



r xu = s 






unless y £ A x or y = x, 


Uxy 


if y € A 9 , 



»€4« 



U) - 2 ''x« if y - *• 



!/€^ 



The normalization condition 7/1 = 1, finally, amounts in terms of U to 

x T* 1 T^ , V (" M+ 15 UX ") 1 

\ I n I tip + 2s S V -±J± L - !■ 

In terms of U the objective function is 

8(l)=0 |-1'| lljllj .s|J)>0 S{.l) \ wl A, / 

X E S E Uy+ E ^( M ~+ ? w *») 

It is possible to describe linear programming problems which are 
equivalent to our nonlinear problem of optimal routing. Two ways of 
reducing (7) to a linear programming problem will now be discussed. 
The first is due to A. Charnes and W. W. Cooper. 8 Let g = tp, where 
the scalar t ^ is to be chosen so that q'a = a, with a > a specified 
real number. Consider now the "adjoined" linear programming problem 
of finding q,t,r minimizing q (0 + r), subject to q,t ^ 0, q 1 - t = 0, 
q'Q = 0, q'a = a, Q = Q(R), r = r(R) = {r„, x € S\, R G C. (The 
argument just described shows that the constraints are linear.) 

Theorem 2: For any a > 0, if q,t,r is a solution of the "adjoined" linear 
problem, then p = q/t is a solution of (7). 

Proof: It is necessary to show first that indeed t > 0. Suppose q,0,r is a 
solution. Then g'l = and q ^ imply q = 0, so that q'a = 0; but 
q'a = a > 0. Hence, £ > 0. 

If p'Q = and Q = Q(R), we use r p to mean the vector {r xx , x 6 S] . 
Now suppose that there is a solution p of (7) for which 

All + r p ) g'(p + r) = g (fl + r) 
p'a g'a a 

Now p'a > 0, because for any R € C the corresponding value of p 



q {ft + r) = g IP -f- r; ^ 



1404 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1966 

(0 = zero state, with no calls up) is > 0, and ao > 0. Hence, there is a 
> such that pa = da. Consider q = d~ l p, t = f l . Then 

6 p a = q a = a 

and q,i satisfy q\,t = 0, qQ = 0, q\ -1=0. But, 

p'(P + r p ) = fV(g + r p ) = q'{p + r) = £(g + r) 
p'a d~ l p'a §'a a 

Hence, (8) implies ^'(/3 -f- r p ) > q (0 + r), because a > 0. This contra- 
dicts the optimality of q,t,r for the "adjoined" problem. 

A cognate reduction to a linear programming problem can be ob- 
tained from a lemma of C. Derman, included for completeness: 

Lemma 2: The nonlinear function 

i \ cx 

s[x) m Wx 

can be minimized subject to x ^ 0, Ax = b, by solving a linear program- 
ming problem if (i) Ax = 0, x = imply x = and (ii) x ^ 0, Ax = b 
imply d x > 0. 

Proof: Conditions (i) and (ii) imply that the transformation 




z = 



is one-to-one between {x ^ 0, Ax = b] and z satisfying z ^ 0, d z = 1. 
and Bz = 0, where 

B = (Ab). 

Under the transformation g(x) becomes a linear function. It can be 
verified that (i) and (ii) of Derman's lemma apply to the routing prob- 
lem (7). 

XII. REFORMULATION AS A MARKOV DECISION PROCESS 

In Section VII the problem of optimal routing was cast as that of 
minimizing the probability of blocking, a bilinear or linear fractional 
functional of the equilibrium probability vector /;, subject to linear con- 
straints. In Section XI it was shown how this problem could be reduced 
to a linear programming problem which, however, is at best only sug- 
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gestive in identifying optimal policies. We shall now state an elementary- 
probabilistic result which implies that minimizing the probability of 
blocking, and maximizing the fraction of events that are successful at- 
tempts, are equivalent. This fact permits a direct dynamic programming 
approach through Markov decision processes, and again leads to a linear 
programming problem, with the difference, though, that it actually 
enables us to study optimal policies for many cases, to be described. 

Theorem 3: Let p be an equilibrium probability vector for a process x t 
resulting from use of some rule R £ C. Let 



m = 23 I x I Pz = average number of calls in progress 

X£fl 



then both 



1 - Pr{bl\ = 



m 



and 



Fraction of events that = ,. n ■ — - 

p (8 T ?*) 
are successful attempts 2 + X 



m 

Proof: For the first formula with s = {s(x), x 6 S\ 
p'(B + r) _ p'(B + r 



Pr[bl\ = 



V 'a p'(s- r) +p'(0 + r) 

and Xp'(s — r) = m, since the average rate of successes must equal that 
of hangups, in equilibrium, and a = 8 + s. 
The second quantity is 

average rate of successes _ \p ( s — /• ) _ m 

average rate of events m + Xp'a 2m + Xp' (0 + r) 

An immediate consequence is: 

Theorem 4'- Maximizing the fraction of events that are successful attempts 
is equivalent to minimizing the probability of blocking. 

The value of the preceding observations is that we can now reformu- 
late the routing problem as an effort to maximize 

lim - 2?{ number of successful attempts in n events}, 
,,-.« n 
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the asymptotic rate of successful attempts when time is counted dis- 
cretely, by events. 

Since only events are at issue, and the epochs at which they occur are 
irrelevant, we can discard the continuous parameter Markov process 
[x t , t real) in favor of a Markov chain \x„ , n an integer}, with a transi- 
tion matrix A = (a xy ) = A(R) given by 



[ | X | + \a x ]a xy = \ 



The stationary vector q satisfying q = q'A is related to p by 



A03. + ? 


XI) 


x = y, 


1 




y e B x , 







y £ A x , 

otherwise. 



p x — (constant) 



| x | + Xa x ' 



Then 



E{ number of successful attempts in n events} = 7. A 3 v 

where A = A(R) and v = v(R) given by 
\s(x) — \r xx 



v x = 



X I -f- A<*x 



= chance that first event to occur 
starting in x is a successful call. 



(9) 



Thus, the problem of optimal routing can be cast in the form of the 
Markov decision processes studied by e.g., R. Bellman 10 and R. Howard: 11 
For R £ C and A = A (R) = (a xy ) given by 



( | x | + \a x )a xu = \ 



MP* + r xx ) 


x = y, 


1 




y € B x , 


\r xy 




ye A x , 







otherwise, 



the minimum 
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. . p'(/3 + r) 

mm rr(o/| = mm - 

«ec see V ex 

subject to p'Q — 0, p ^ 0, p'l = 1 is achieved by the ft which maxi- 
mizes the scalar p such that 

pl-limiS A'» »«»(«), A=A(fl), ft e C 

n-»»W ,=0 

with y given by (9). 

The results of Bellman in Ref. 10 were derived under the strong posi- 
tivity condition a xy ^ d > on the matrices A; this condition is of 
course not met in our routing problem, since many a xy necessarily vanish. 
However, since our matrices have only one ergodic set it is still possible 
to obtain results like Bellman's provided only that a little care is taken 
with the transient states. 

Lemma 3: Let p be the scalar defined by 

1 " _1 
pi = max Urn - 2^ A'v, (10) 

R£C n-»« fl j'=0 

let R + achieve the maximum in (10), and let g be the vector determined up 
to a multiple of (the vector) 1 by the equation 

pl + g = v(R + ) + A(R + )g. 

Let R* achieve the maximum in 

max [v(R) + A(R)g\ 

R£C 

Let V be the transient set of states relative to A (R*). Then the restriction 
of g to S — F satisfies the nonlinear equation 

P + g x = max {v x (R) + £ a xy (R)g y \, x £ S - F, (11) 
and the right-hand side of (11) depends in fact only on 

[g v ,y€ s-F}. 

Further, there is a fixed routing matrix R**, agreeing with R* on (S — F) 2 , 
and a vector g* agreeing with g on S — F, such that ft** achieves the max- 
imum in 

pl+0*= max \v(R) + A(R)g*\. 



RfC 



Proof: If the nonlinear equation given does not hold for some x € jS — F. 
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there exists a vector f with T ^ 0, f ^ such that on S — F 

p + f x + g* = max [v s (R) + £ a*y(R)g v }, 

nee v 

= v x (R*) + T,a xu (R*)g y . 

V 

Let us restrict all vectors to the | S — F | components present in S — F, 
and the matrix A (R*) to (S — F) 2 . Then, dropping dependence on R* 

pi + f + g = v + Agr. 

There exists an integer fc such that A k > strictly. Left-multiply by 
.A* and note that A 1 = 1 to obtain 

pl +A fc (f + <7) = A k v + A k+1 g. 

Since A fc is a positive matrix, and £ ^ 0, £ ^ 0, there exists a scalar £ 
such that A fc J ^ el, so that 

(p + e)l + A k g ^ A k v + A* 4 ** 

Iterating this inequality n times we obtain 

Jfc+n-l 

n( P +e)l + A k g g £ AV + A fc+ Y 

For w large enough this contradicts the maximal character of p. To find 
R** and gr*, consider the equation 

g x * = - p + max \v x (R) + 2 a xy (R)g y * + 2 fl«(fi)ff»}, 0! € F. 

This represents the expected best possible fortune of a gambler who 

starts broke in state x G F, plays by choosing a matrix R paying an 

amount p to play, receiving v x (R) if he plays R in state x, and ending 

the game with a final payoff of g v if the system leaves F for the first time 

by going into y ^ S — F; i.e., if he passes through aftfe • • • z n ?/ playing 

^1^2 • • • R n (with Ri in .r,), going out to y £ S — F from .r„ , then he 

receives (or owes) 

» 

—rap + 2 v Xi (Rt) + 0„. 
t=i 

It is apparent that {^*, x £ F] exist; #** on F 2 U (F X S - F) is de- 
termined by the property that it achieves the maximum above, and on 
(S - F) X Fit is zero. 

Lemma 4- Let p be the scalar defined by the condition 
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1 " _1 

pi = max lim - 23 A ] v, (12) 

figC n-»«o 11 j=0 

and let the vector g be a solution of the nonlinear inequality 

pl + g ^ max \v(R) + A(R)g}. (13) 

If R* £ C achieves the maximum on the right of (13), then it also achieves 
that on the right of (12). 

Proof: R* and g are related by 

P l + ^ v(R*) +A(R*)g, 

whence, left-multiplying by A 3 = A 3 (R*) and summing on j from to 
(n - 1), 

npl + S A'f ^ Z A'* + E A^ 

j=0 ;"=0 j=l 

n-1 

z 

n j=o 
This implies that R* achieves the maximum in (12). 



pl--ElWo(l) A = A(/2*), v = «(#*). 



XIII. OPTIMALITY OF FIXED RULES 

If a routing matrix has any entries other than integers, its use intro- 
duces a certain amount of additional randomness into the operation of 
the network, over and above that due to the random traffic, and may be 
said to represent a "mixed" strategy. It is a natural intuition that since 
minimizing the probability of loss is a game played against nature, rather 
than against an intelligent adversary, there can be no real gain from this 
additional randomization, i.e., that a fixed rule can be found that is as 
good as any "mixed strategy". To this effect we formulate 

Theorem 5: A fixed ride R achieves 

. p(P + r) 

min ■ — — ; 

pa 

subject toR£C, pQ = 0, pl = 1, p ^ 0, Q = Q(R). 

This theorem is a consequence of the next two results, which, though 
they are adapted from work of C. Derman, 9 are included here for com- 
pleteness. 

Lemma 5: Let £(■)•* C — » E iBi be an a fine map of C into \ S \ - dimen- 
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sional Euclidean space, i.e., one such that for real scalars ai , a 2 ^ with 
a\ + a 2 = 1, and R\ , Rz 6 C, 

£(aifli + a 2 fl 2 ) = ai£(fli) + a 2 £(fl 2 ), 

and let £ be continuous. Then, 

min q £ 

subject to q ^ 0, q'l = 1, qA = g, A = A(R), % = £(R) is achieved by 
a fixed rule R. 

Proof: For R € C and A = A (R), $ = % (R) set 
v(R) = limiE A y £. 

n.-»oo 71 ;=0 

By a known Markov chain limit theorem, 12 v(R) is well-defined. For 
M € (0,1) let 

V(R,n) -Z(#iA)'«. 

,=0 

It is clear that for each m (E (0,1 ), and each starting state x, there exists 
an R^ 6 C 

V x (R llXi n) = min F a (i2,/i). 

Then 

V x (R**,n) = min {{,(«) + M Z *w(JZ)7,(22„.,m)}. 

The right-hand side is an affine functional of R and so assumes a mini- 
mum at an extreme point of C, i.e., at a fixed rule R. Thus, we can con- 
sider that Rpx is a fixed rule. Since the fixed rules form a finite class, 
there exists a sequence p n — ■> 1 and a fixed rule R such that 

R„ nX = R* n = 1,2, 
By a well-known Abelian theorem, 1 for R 6 C 



and also 



lira (1 - n)V(R,u) = v(R) 



v(R) ^ lim (1 - n n )V(R }l in) 
^ lim (1 - M»)7(B*,Mn) 

n-»» 

^ KB*)- 



Thus, 7?* is optimal. 
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Theorem 6: Let f,Tj: C — > i? |S| be affine maps of C into \ S \ - dimensional 
Euclidean space, and let i- and -q be continuous, with 77 (.ft) > for R £ C. 
Then 

• ff'f 

b = mm V 

subject to q ^ 0, </A = g, g'l = 1, A = A (R), £ = £(22)> a™d V = v(R) 
is achieved by a fixed rule. 

Proof: Let b(R) be the value of qZ/q'y for a given choice R, with g 
determined by the constraints q ^ 0, q A = q, q 1 = 1. There exist 
Ri, R2, • • ■ € C such that 

lim 6(/2») = 6. 

For n fixed, let £(• ) in Lemma 5 be given by 

5 = f - &(£.)* 

Then in the notation of Lemma 5, v(R„) = 0. By Lemma 5 there exists 
a fixed rule R* such that 

vifi*) ^ v(R n ) 

^ 0, 

that is, since q rj ^ 0, 

b(R n *) S b(R n ). 

Since there is a finite number of fixed rules, there is a subsequence 
Wi , W2 , • • ■ and a fixed rule R* such that R„* = R*, i = 1, 2, • • • . 
Then R* is optimal. 

XIV. TRYING TO GET CLOSER TO THE OPTIMAL ROUTING RULES 

It is particularly important to try to verbalize, and eventually to 
mechanize, routing strategies that are optimal, near-optimal, or by some 
yardstick just "good". In this endeavor, the fact that the original routing 
problem (7) can be formulated and solved numerically as a linear pro- 
gramming problem, while interesting theoretically and perhaps reassur- 
ing, is nevertheless of limited usefulness. For this reason we have 
attempted to take advantage of some of the special properties of the 
problem that are due to its telephonic origins, and to describe at least 
parts of optimal policies in terms of the combinatorial properties of the 
connecting network upon which they ultimately depend. 
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In the second half of this paper we introduce some additional notions 
and assumptions of a combinatorial nature. With their aid we are able to 
exhibit parts of some actual optimal routing rules. The problem of finding 
out something concrete about optimal policies has been so difficult that 
we have quite frankly started with (and so far restricted attention to) 
cases which can be treated by what T. M. Burford has called "domina- 
tion" arguments, which depend on or establish isotony 5 properties for 
certain networks having suitable monotone structures. The word 'mono- 
tone' is used loosely here: more specifically, the networks are to have the 
property that the relative merit of states is consistent or continuous, i.e., 
that if one state x is "better" than an equivalent state y, then the neigh- 
bors of x are in the same sense "better" than the corresponding neigh- 
bors of y. 

Although some of the combinatorial properties (on which the results 
to be given are based) are strong, we believe that these properties and 
the optimal policies (or partial policies) they lead to have a definite 
relevance to the practical aspects of optimal routing, if only because 
they bear out some of the intuitive conjectures offered in Section VIII. 
Our results show not only that these conjectures are "in the right ball- 
park," but also thpt in many instances they describe optimal policies. 

We start our discussion with four simple examples; once the ideas in- 
volved are understood, the principles behind them can be abstracted, 
and general theorems proved. 

It has been shown (Section XII) that minimizing the probability of 
blocking is equivalent to maximizing the fraction of events that are 
successful attempts, where an event is either a hangup, a blocked at- 
tempt, or a successful one. This maximal fraction is the limit, as n be- 
comes large, of 

-E x (n), 
n 

where 

E x (n) = expected number of successful calls in n events, if the net- 
work starts in state x and an optimal policy is followed, f 
We shall base our approach on the vectors E(ri). 

First example: Consider the overflow system or grading shown in Figs. 7 
and 8. There are two groups of lines, each of two lines; the first has ac- 
cess to both trunks to the destination, but the second has access to the 
second trunk only. The possible states of this system (reduced under the 

t Here an optimal policy is one for which the expected number of successful 
calls in n steps is a maximum. 
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LINE GROUP I - 



LINE GROUP 2 



i- 







^ — r? 



= CROSSPOINT 



Fig. 7 — Asymmetric grading. 

equivalence relation induced by permuting lines within a line group) 
form the partially ordered system of Fig. 8. There is only one situation 
which demands a choice between alternative routes for a call; it arises 
when a call from line group 1 is accepted with no calls in progress. The 
two alternatives are indicated in Fig. 8 by the notation "ch": one is to 
put the call on trunk 1, leaving no lines blocked, the other is to put it on 
trunk 2, leaving 2 lines blocked. 

What circumstances make one choice of a route better than another? 
In the present instance it is clear that use of trunk 1 for a group 1 call in 
state leaves the "high access" trunk 2 free to serve group 2. Thus, at 
first glance a route whose use blocked the smallest possible number of 
additional calls (over and above those that are already blocked) seems to 
be best. It is natural to expect that in state a new call from group 1 
should be routed on trunk 1 and not on trunk 2. Indeed, it can be shown 
that if such a call should be accepted then it should be placed on trunk 1 . 
(For small X it should always be accepted, as was proved in .Section X.) 
Thus, a policy which routes a group 1 call on trunk 1 in state can differ 



(1-1)0-2) 



(1-11(2-2) 



(1-D 




(2-2) 



A 



(1-2): 



THIS NOTATION INDICATES A 
CHOISE IS POSSIBLE BETWEEN 
TWO DIFFERENT WAYS OF PUTTING 
UP A PARTICULAR CALL 

A CALL FROM GROUP 1 IS ON 
TRUNK 2 



Fig. 8 — States of the grading of Fig. 7. 
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from an optimal policy only in that it might accept some calls which the 
other rejected, and vice versa. 

Rather than proving the result stated above, we shall discuss other 
examples, involving different kinds of network: it will turn out that 
similar circumstances arise. Indeed, we shall claim that the particular 
circumstance on which the result is based is no isolated happenstance, 
but a phenomenon common enough to be relevant to the theory of rout- 
ing. All examples discussed here, as well as many others, will be covered 
by a general result (Theorem 14) proved later. 

Second example: Referring to Fig. 2, which shows the reduced state di- 
agram of the three-stage Clos network of Fig. 1, we observe that only in 
the state numered 4 are there any blocked calls. State 4 realizes the same 
assignment of inlets to outlets as state 2, which has no blocked calls. The 
difference between the two is that in state 2 all the traffic passes through 
one middle switch, leaving the other entirely free for any call that may 
arise. This difference illustrates the intuitive rule that one should always 
put a call through the most heavily loaded part of the network that will 
still accept it. This example was discussed in Refs. 1, 2 where it was shown 
(rather laboriously) that if no calls are rejected, then preferring state 2 
to state 4 in state 1 is optimal. This result will be an instance of Theorem 
14. 

Third example: It is to be expected that in some instances a choice of 
route for a call is immaterial. The concentrating switch depicted in Figs. 
9 and 10 is a simple example of this phenomenon. It is intuitively ob- 
vious that, because of the symmetries of the network, it makes no differ- 
ence which of the two trunks a call could use when the system is empty 
is assigned to it. This insensitivity of performance to routing choices 
can actually be deduced from Theorem 7. 
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Fig. 9 — Symmetric grading. 
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Fig. 10 — States of the grading of Fig. 9. 

Fourth example: Figs. 11 and 12 show the structure and (reduced) state 
diagram for another simple Clos network made of 3 X 3 inlet and outlet 
switches, and 2 X 2 middle switches. Again, from scrutiny of the state 
diagram we guess that optimal routing will result if no empty middle 
switches are used when partially filled ones are available. The notations 
'/?' in Fig. 12, intended to suggest that the states to the left of the B's 
are "better" than those on the right, constitute an expression of the cor- 
responding policy, and are explained in the next paragraphs. 




Fig. 11 — 3-stage Clos network with 3X3 outer switches. 
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<> <A> E 




Fig. 12 — States of 3-stage Clos network of Fig. 11. 

To abstract the essential features of the preceding examples into a 
general theorem, we start with the observation that in choosing to enter 
a state x rather than another y in putting up a call we have always to 
choose between equivalent states (a: ~ y, in the sense of Section III), in 
which the same events e can occur. In particular, the same new calls c 
can arise. If it now happens that every new call blocked in x is also blocked 
in y, let us regard this as prima facie evidence that x is somehow "better' ' 
than y, and define a relation B £ S 2 by the condition 

xBy if and only if x <-" y and 

c £ x, c blocked in x imply c blocked in y. 

The relation B is a partial ordering. 
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In the first example considered above, (1-1 )B (1-2), and B obtains 
between no other distinct states; in the second, 254, and again B ob- 
tains between no other distinct states. 

Let us now suppose (for a general network with state set S) that the 
network is run according to a policy <p, and ask what happens to B under 
(p. That is, more specifically, we look at states x,y such that xBy, and we 
consider, for events e that are either hangups or new calls blocked in 
neither x nor y, whether or not 

ip(e,x)B<p(e,y). 

If e occurs and <p is used for decisions, then the system moves from x 
to <p(e,x) and from y to <p(e,y). If <p(e,x)B<p(e,y) for all e € x that are 
either hangups or new calls blocked in neither x nor y, whenever xBy, 
we say that ip preserves B. Formally, 

<p preserves B if and only if xBy implies <p(e,x)B(p(e,y) for 

e 6 x which are either hangups or new calls 

blocked in neither x nor y. 
In the first example (Fig. 8) there are no new calls c which can be 
put up in both (1-1) and (1-2), and there is one hangup (say h) which 
can occur in both. Thus, the set of events to be considered is just [h\. 
Clearly, <p(/i,l-l) = <p(/*,l-2) = state for any <p. Since B is reflexive, 
we conclude that in this case every (p preserves B. 

In the .second example, a similar situation arises. There are two 
events to be considered: one is a new call computable in both 2 and 4 
leading to state 0, the other is a hangup leading to 1 . Again 

<p(e,2) = <p(eA) 

for all cp and both events e to be considered, and again any <p preserves 
B. 

As noted, routing has no effect in the third example. However, the 
relation B is defined. It can be verified that any <p preserves B, and that 
in this case B is a symmetric relation, as it should be, since if routing 
is to have no effect, then x can only be "just as good" as y if y is "just 
as good" as x. These facts can be used to prove that routing has no 
effect in this example. 

The fourth example, finally, shows the relation B in action. The 
notations 

x — B — > y x,y states 

in Fig. 12 show the irreflexive part of B. (Obviously xBx for all x 6 S, 
and this part of B is not shown in Fig. 12.) The reader is invited to 
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verify that the policy <p of using a partly-filled middle switch whenever 
possible does indeed preserve B in this example. 

The property of a policy ip, that it preserves B, is to be viewed as a 
kind of isotony of <p: 

xBy implies tp(e,x)Btp(e,y), for suitable e. 

(See G. Birkhoff," p. 3.) It can also be viewed as a kind of continuity, 
for after all if we think of the set of neighbors N u of y as the states in 

N y = A y U B u , 

then the property says that if xBy then also zBw where 2 is a neighbor 
of .j- and iv a neighbor of y such that z ^ w. In other words it states 
that if a- By then also 

(N x XN U ) D (~) £B, 

i.e., if it holds between x and y then it also holds between equivalent 
neighbors of x and y. 

Note that if <p preserves B, xBy, and <p rejects in x a call c not blocked 
in y, then it also rejects it in y. 
For (p a policy, let 

E x (n,<p) = expected number of successful attempts in n events, 
if the network starts in state x and policy <p is 
followed. 
The isotonic property that <p preserve B has the useful feature that it 
implies an isotony among the numbers 

{E x (n,<p), n ^ 1, xe 8). 

This is the content of the next result. 

Theorem. 7: (First Isotony Theorem): If <p preserves B, then xBy implies 

E x (n,<p) ^ E y (n,ip), n = 1, 2, • • • . 

Proof: xBy, c 6 x, <p(c,y) j* y imply <p(c,x) ^ x. Hence, 

E is S 1, 

¥>(c,x)=l H>{c,y)=y 

and E x (l,(p) ^ E y (l,<p). As a hypothesis of induction assume that xBy 
implies 

E x (n#) ^ E„(n,<p) 

for some n ^ 1. We have 
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E x {n + \#) = E i i i ^ (1 + E^ c , z) (n,<p)) 

V <.c,x)t^x 

+ ^^r- JS-OmO E 1 + i , * E E*-h(n#>). 

\x\ + Xa x c€ r |X| + \a x hex 

V»(c,z)=x 

Since <p preserves B, it must be true that xBy implies 

<p(c,x)B<p(c,y) 

(x - h)B{y - h), 



whence 



Therefore, 



Eru,x)(n,ip) ^ E vie , V )(n,<p) 
E x -h(n,<p) ^ Ey-h(n,<p). 



E x (n + l),<p) ^ E | rj^ 1 1 + E, (e , v) (n#) } 

C 6V \X\ + Atty 

+ |M, *,(»*) E i 

+ ..,. E E v - h {n,<p) 
\y\ + A«v »€* 

The power and utility of the relation J5 are further illustrated by the 
following comparison theorem for policies. The partial ordering B on S 
induces a natural partial ordering B of the policies according to the 
definition 

«pB^ = e £ x, x 6 <S imply <p(e,x)B\l/(e,x) 

for e a hangup or a call not blocked in x. We note that <pB\p implies that 
<p and yp embody the same rejection policy. 

Theorem 8: If <pB\p, and one of <p,\p preserves B, then xBy implies 

E x (n,<p) §: E x (n,f), n = 1, 2, • • • . 

Proof: (p and \J/ have the same rejection policy, so E(l,<p) = E(l,if/), 
and the theorem holds for n = 1. Assume as a hypothesis of induction 
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that xBy implies E x (n,ip) ^ E y (n,\f/) for a given value of n ^ 1. We 
have, with p ex = Pr{e occurs in a;}, 

E y (n + l,<p) = E y {\,<p) + 2Z PeyE^ e , V )(n,<p). 

But e 6 ?/ implies <p{e,y)Byj/(e,y), and so by the induction hypothesis 

E*(e,v)(n,<p) ^ E^ e ,y)(n,^). 
However, 

tf„(n + 1,*) = ^(MO + 2 P*yE+<e.v)(n,$) 

^ E v (n + 1,*>). 

Let now xBy, and suppose that <p preserves B. The isotony theorem 
then implies 

tf.(n + l,*) ^ £„(«+ 1,*) 

^ tf„(n+l,*). 

If, instead, ^ preserves 5, then 

tf,(n + 1,*) ^ £,(rc + 1,*) 

and a repetition of the first part of the argument above with x instead of 
y gives 

E x {n + l,<p) ^ E x (n + 1, *) 

^ ^(n+ l,f). 

XV. SECOND INTUITIVE APPROACH 

In an effort to develop a more general theory than the one that was 
begun in the previous two sections, we now make a fresh start at under- 
standing the structure of "good" routing; again, we begin with a special 
case: 

Fifth example: We choose the overflow system or grading depicted in 
Fig. 13. There are two groups of lines, one of two lines, the other of three 
lines. Each has access to one primary trunk to which the other does not 
have access, and they share a single common overflow trunk. The possible 
states of this system form the partially ordered system shown in Fig. 14. 
Alternative ways of putting up particular calls are marked with "ch", 
for "choice". 

After inspecting the system and its state diagram, intuition tells us 
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Fig. 13 — Second asymmetric grading. 

that, as a first guess, calls should use the primary trunks whenever they 
can, so as to leave the overflow open as much as possible. Let us, on this 
basis, formulate some preferences for certain routes. 

Clearly, in state a call from group 1 should go on trunk 1, so in state 
we prefer state (1-1) to (1-3); similarly we prefer (2-2) to (2-3). The 
same principle should apply if certain calls are already in progress. 
Thus, in state (2-2) we prefer (1-1) (2-2) over (1-3) (2-2), and in state 
(1-1) we prefer (1-1) (2-2) to (1-1) (2-3). 

If taken seriously and followed, the preferences listed above define a 



TWO CALLS 
BLOCKED 



(l-l)(l-3)(2-2)-*-"' ""-*.(l-l){2-2)(2-3) 




(1-0(1-3) 0-3H2-2) (1-1)12-2) (1-0(2-3) (2-2)(2-3) 




ALL OTHER STATES HAVE 
NO CALLS BLOCKED 



Fig. 14 — States of the grading of Fig. 13. 
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policy for putting in calls. We shall show that this policy differs from the 
optimal policy only in that the latter may reject some calls, while the 
former accepts all unblocked calls. To do this write xPy if state x is 
preferred to state y. Thus, the relation P is denned by the conditions 

(M) P (1-3) 

(2-2) P (2-3) 

(1-1 ) (2-2) P (1-3) (2-2) 

(1-1) (2-2) P (1-1) (2-3). 

We let 

E x (n) = expected number of successful call attempts in n 
events, if the system starts in state x and an optimal 
policy is used. 
It must be explained here that by "use of an optimal policy" over n 
steps we mean simply that we use a policy which will maximize the 
average number of successful attempts among those n events ; the policies 
that achieve this may, for all we know at this point, be different for 
different n. 

A slight departure from the probabilistic model of Section VI is 
necessary here: we assume that an idle line generates calls to the trunk 
destination at a rate X > 0, instead of assuming that an idle inlet-outlet 
pair generates calls at X. Also, we let a x be the number of idle lines in 
x, rather that than that of idle inlet-outlet pairs, and s (x) that of 
idle lines that are not blocked. 

Theorem 9: If xPy, then 

E x (n) ^ E y (n) n = 1, 2, 3, • • • . 



Proof: 



E x {\) = 



U{x) 
\x\ + \a x 



and xPy implies s(x) ^ s(y), so the theorem is true for n = 1. Assume 
that the theorem holds for some n ^ 1. There are four cases, correspond- 
ing to the four conditions denning P. We shall give the argument for 
the case where 

x = (1-1) (2-2) 
y = (1-3) (2-2), 
and (as we know) xPy; the others are similar. 
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Now apparently 
A'(i-i)<2-2) (n+ 1) = - t x ox [E iM )(n) + ^(i_i)(»)} 

max { #(i.i) (2-2) (n), 1 + #o-i)a-» («-»(»)} 

- X maX ^ a - 1)(2 - 2) ^ n ^ l + #(i-D (2-2) (2-3) (n)) 
and 

#«.-3)( 2 -2)(n+ 1) = — Tgj; 1-EWrO + #a-3)(n)| 

+ 2 -L 3X maX {#d-3)(2-2)(w), 1 + #(1-1) (1-3) (2-2) (n)} 

+ n 7 o X #(i-3) (2-2) (n). 

By the induction hypothesis, 

#(i-i» (») ^ #(i-3) (n) 

#(1-1) (2-2) (W) ^ #(1-3) (2-2) (W) J 

hence, 

#*(» + 1) ^ #„(n+ 1) 

for the given x and y. 

The point is that each event that can occur leads to a "worse" state 
in y than it does in x. Thus, the hangup of the group 1 call leads both 
to the state 2-2, a standoff; hangup of the group 2 call takes x into (1-1) 
and y into (1-3), and (1-1 )P (1-3); one of the possible new calls leads 
both .r and y to the state (1-1) (1-3) (2-2), another standoff; the other 
two possible new calls are blocked in y but not in x, so that by the 
induction hypothesis, rejecting one of them and staying in x is at least 
as good as having one of these blocked calls make an attempt in y. 

We conclude from Theorem 9 that in an optimal policy the calls 
which are not rejected are put on the primary trunks if these are avail- 
able, and on the overflow only if the primary trunk appropriate to the 
call is already busy. This result is entirely in agreement with our original 
intuition. 

Another example of the same kind is shown in Figs. 15 and 16: the 
intuitive preferences shown in Fig. 16 by l P' are optimal to within 
rejection of unblocked calls. 
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TRUNKS 
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Fig. 15 — Third asymmetric grading. 

We now formalize the principles behind the intuitions that led to 
Theorem 9. 

Let P be a relation on S, i.e., a subset of S 2 . We may as well put our 
cards on the table and indicate that P is to be interpreted as a relation 
of "preference", with xPy meaning "x is preferred to y". If n is a func- 
tion, and X,Y are sets, the (customary) notation 

M : X++Y 

means that /x takes X into Y in a one-one manner, while 

M : X^Y 

means that the ju-image of X is contained in y. 

We say that P has the strong monotone -property if xPy implies 

(i) | x | - | y | 

(it) 3/i : B x *-> By such that z £ B x implies zP\iz 
(Hi) 3v: A y — > A x such that 

e(A<*) (ZA ex for c £ y, 

(14) 
zG 4 B implies vzPz. 

Let us denote by F x the set of all calls which are free or idle in x, i.e. 

F x = [c: c is idle in x] = {y(y - x): y £ A x \ 

= {c: c = { (u,v)} C/X2 with u,v both idle in x). 

We say that a relation P on S has the weak monotone property if xPy 
implies 

(i) | x | - | y | 

(n) 3u: 5 Z «-» £j, and z £ B x implies zP\iz 

(Hi) 3v: F v -+ F x and c € F v , z € A v 

imply 3to 6 A {vc)x with iwPz. (15) 



OPTIMAL ROUTING IN TELEPHONE NETWORKS 



1425 



To get the weak monotone property from the strong, define v on 
F v hy 

vy(z - y) = y(vz - x), z € A v ; 

then z 6 Acy implies vz £ A x , and 

vc = y(vz — x); 

thus, 

vz £ A(_ vc)x and vzPz. 

Keeping in mind the interpretation that ( xPy' means that x is in 
some sense better than y, we see that: condition (i) restricts P to hold 
only between states of the same norm or dimension, because we are 
interested only in choosing between states with the same number of 
calls in progress; condition (ii) says roughly that to every hangup lead- 
ing out of state y there corresponds a hangup in x leading to a state 
winch is at least as "good" (as the one reached by the hangup in y); 
condition {Hi) says that for any way of completing a new call c in y 
there is a way of completing the same call c in x which leads to at last 
as "good" a state (as the one reached by completing that call in y). 

It is easily seen that P has one of the monotone properties if and only 
if xPy implies that P holds between "corresponding respective" neigh- 



(l-l)(2-2)(3-3) 




Fig. 16 — States of the grading of Fig. 15. 
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bors of x and y. Thus, the monotone properties are similar to the prop- 
erty of a policy <p that it preserve B. The principal differences are that 
here no policy is at issue, and that the meaning of "conesponding neigh- 
bor" is weaker than in the definition of preservation. The relationships 
to the relation B are further clarified in the following remarks. 

If P has the weak monotone property, then xPy implies a (a;) ^ s(ij). 
If P has the strong monotone property, then xPy implies that every 
c € x blocked in x is blocked in y. Further, since we are primarily inter- 
ested in comparing equivalent states (i.e., x and y such that x ~ y), it is 
natural to restrict attention to preference relations P which are subsets 
of ~, P £ ~. It can then be verified that if P has either monotone 
property, and holds only between equivalent states (P C ~), then 
P Q.B. 

A "preference" relation should impose at least a partial ordering 
among the objects for which it is defined, and so it is by nature transi- 
tive. The question then arises whether the relations P that have the 
(strong or weak) monotone property are reflexive and transitive. It is 
obvious that if P has the monotone property then so does I \J P where 
I is the identity relation. Now, as is known, every relation P can be ex- 
tended uniquely to its transitive closure P, the smallest transitive rela- 
tion containing P. We shall now prove: 

Theorem 10: If P G S 2 has the weak monotone property, then so does Us 
transitive closure P. 

Proof: Clearly P = P U P 2 U P 8 U • •• , where the powers represent 
relative, not Cartesian, products. It is obvious that xPy implies | x | = 
| y |, so P has property (i) of (14). Next let xPy, so that there exist 
21 , 22 , • • • , Zn £ S such that z x = x, z„ = y and 

ZiPzi+i i = 1, ■••,»— 1. 

Thus, there exist maps m , m , • • • , m«-i with m : B H <-> B 2i+l such that 
26 B Zi implies 

zPmz. 
Hence, z £ B x implies 

zPfliZ 

mzPuzuiZ 



jll„_2Mn-3 • • • HlzPfln-Wn-l ' ' ' Ml2) 
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i.e., 

:/' 

Thus, 



(S"> 



n-l 

M = II Mi 

has the property that n : B x <r+ B y and z £ B x implies 2P/1Z. Hence, P 
has property (n). Finally, there exist maps vi , ••• , i» n _i with v„_,-; 
F* 1+1 — ► F*. such that c 6 F« i+i , z € 4e« i+I implies to 6 4( V ) 2i+1 
with toPz. Let 



n-l 

n 



v = n»<. 



Hence, for each c £ F y , w n £ Acy there exist w„_i , ■ • ■ , w n 6 $ and 
c„_i • • • c n _isuch that 

d = vid + i , Wi 6 A c , z ,. , WiPwi+i i = 1, • • • , n — 1. 

It is apparent that c\ = vc, Wi(z A ( VL ) X and WiPw n , so that P has property 
(*w). 
The following result is now immediate: 

Theorem 11: If P has the weak monotone property, and I is the identity 
relation, then 



(/UP) 

is a partial ordering relation with the weak monotone property. 

Any relation with the weak monotone property can be extended to be 
a partial ordering P that has the weak monotone property. Since ~ is an 
equivalence relation between states, and P is a partial ordering, it fol- 
lows that P D <-*> is also a partial ordering. 

Theorem 12: (Second Isotony Theorem): If P £ S 2 has the weak mono- 
tone property, then 

xPy implies E x (n) ^ E y (n), n = 1, 2, • • • . 

Proof: Property (15) (Hi) implies that s(x) ^ s(y) whenever xPy. 
Now 

EAD= Mx) 



\x\ + Xaj ' 
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Since it is assumed that «» = a\ x \ we have, by (15) (i), 

xPy implies E x (\) ^ E v {\). 

As an hypothesis of induction assume that xPy implies E x (n) ^ E y (n). 
We have 

EJn + 1) = i i , ; — 2 max {#*(»), 0(c,x) + max # z (n)} 

|X| + A Ota cgx zG^ci 

\X\ t A«i Agx 

and a similar expression for B„(« + 1). If now a;/ 3 ?/, then | x | = \y\ 
by (15) (*), and also 

E x - h (n) ^ E^ x - h) {n) 
by (15) (n) and the hypothesis of induction. Similarly, 



fl.(n) ^ ,,T" J^(n). 



|z| + Aa* x r \y\ + Aaj, 

For c not blocked in ?/, and z £ Acy , xPy implies that there exists w 6 
A (vc)x with wPz, by (15) (m). By the hypothesis of induction, this 
implies that 

E w (n) ^ E,(n). 

Since z 6 ^.c„ was arbitrary, we find 

g(vc,x) + max E„(n) ^ 0(c,y) + max E z (n). 

It follows that xPy implies E x (n + 1) £ E y (n + 1). 

XVI. RELEVANCE OF THE ISOTONY THEOREMS TO OPTIMAL POLICIES 

Let c 6 z be a call that is not blocked in state x, so that A cx ^ 0. If 
the hypotheses of one of the isotony theorems obtain, then it may be pos- 
sible to single out some of the states y € A cx as providing ways of complet- 
ing c in x which are at least as good as certain others. Specifically, the 
sort of comparison we can make is this: If y,z £ A cx and yBz or yPz, then 
y is at least as good as z in the sense that 

E v (n) ^ E z (n), n = 1, 2, • • • . 

Suppose now that there is at least one y 6 A cx such that yBz for all 
z £ A cx ■ It then follows that such a y is always at least as good a choice 



OPTIMAL ROUTING IN TELEPHONE NETWORKS 1429 

as any other state of A CI , in the above sense. A similar result follows if 
there is a y 6 A cx with yPz for all z f A cx . In such situations a policy that 
routes c so as to take the system from x to y can differ (so far as x and c 
are concerned) from an optimal policy only in the respect that an optimal 
policy might reject c in x. This is the sense in which the isotony theorems 
can provide the part of the solution of the routing problem which has to 
do with choosing routes for accepted calls. Two theorems to this effect 
appear in Section XVIII after an aside about equivalence of decisions 
and nonuniqueness of optimal policies. 

XVII. EQUIVALENCE OF DECISIONS AND NONUNIQUENESS OF OPTIMAL 
POLICIES 

It is natural to expect that there are often several optimal policies, in 
the sense that, for some c and x with c 6 x and A cx ^ 9, there are two 
choices of a route for c in .r which are in some sense distinct routes and 
yet are both equally "good". For example, in most traffic models for a 
graded or progressive multiple it often does not make any difference 
which trunk in a group is used for a call: the possible states resulting 
from use of one of the trunks in the group are all distinct, yet all are 
equally "good", being "equivalent" under permutations of trunks within 
the group. It is intuitively clear that such a nonuniqueness of optimal 
policies is due in large part to symmetries in the network under study, 
or more generally, to the presence of various equivalences of states (and 
hence of routing decisions) under certain groups of permutations of 
terminals.! Since some of these equivalences appear in a later proof, we 
digress a little for an account of them, first heuristic, then formal. 

As we have seen, one of the principal tools in the description of optimal 
policies is a combinatorial partial ordering, such as B or P, which implies 
an ordering in terms of performance. The discussion to follow is based on 
a general partial ordering R, which the reader can assume is contained 
in 

U Aj 

and which he can interpret as B or P, if he wishes. J 

Let then R be a partial ordering of S and let Y be a subset of S. Cued 
by the remarks of Section XVI, we want to use R to compare states; in 



t It should be noted that the word 'group' is used in this paragraph in two tech- 
nical senses, the first from traffic theory, referring to a set of trunks, the second 
from the theory of groups. 

J This use of 'R' is peculiar to this section, and should not be confused with R 
as a routing matrix. 
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particular we wish to talk about elements y € Y such that yRz for all 
2 £ Y. It would be satisfyingly simple if at this point we could introduce 
the notation 

sup Y 

R 

for that element of Y which bears R to every other element of Y. Un- 
fortunately this is usually impossible, because there may be several or 
many such "suprema" of Y. In this situation the usual mathematical 
trick to use is to pass to suitable equivalence classes. Use of this pro- 
cedure is further justified by the fortunate fact that, in the case of several 
interesting choices of R and F, there are several senses in which these 
maximal elements turn out to be equivalent. What is more, there is a 
natural equivalence based only on R, such that sup Y can, if it exists, be 

R 

defined in the "quotient" set of the equivalence, i.e., in the image of the 
semi lattice homomorphism that takes each state into the equivalence 
class to which it belongs. 

If R = P and P has the monotone property, then all the P-suprema of 
A ex are equivalent in this very important sense: If y\ , • • • , y m is an 
enumeration of all the y 6 A cx that are best in the sense that yPz for all 
z 6 A cx , then 

ViPVi , 1 ^ i t 3 = m 

and the second isotony theorem gives 

E Vi (n) = E Vj (n) n - 1, 2, • • • , (16) 

so that as far as performance is concerned, y\ , • • • , y m are all "equiva- 
lent". In many cases, this fact is based on an underlying equivalence of a 
combinatorial nature, much stronger than (16): e.g., in a trunk group 
the different states attainable by different choices of a trunk for a call are 
equivalent in the sense that given any two there is a renaming or per- 
mutation of the trunks which carries one into the other. 

The isotony theorems provide ways of translating a combinatorial 
comparison of states such as 

xBy, or xPy 

into a numerical comparison of the relative merit or value of starting in 
each state, x or y. In such a setting it is natural to call x and y "equiva- 
lent" if the comparison holds both ways, i.e., if, when interpreting 
'xBy' as a (rather strong) precise form of 'x is better than y', we have 
both 
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xBy and yBx. 

Lemma 6: Given two states y,z there exists at most one pair c,x such that both 

y,z € Aex . 

Proof: If y,z € A cx then x = y D z in the sense of the semi-lattice of states. 
Thus, x is unique. If now 

y,z e A cx fl A c t x 

then c = y(y — x), c = y(y — x), so c = c. 

The foregoing observations are the motivation for the ensuing de- 
velopment. With the partial ordering R we associate the natural equiva- 
lence relation = fl defined by 

z = B y if and only zRy and yRz and 3A CX y,z e A cx . 

The subscript R will usually be dropped as long as it is contextually 
clear what R is being used to define =. Along with = we introduce the 
semilattice homomorphism 

r ( • ) : S — * { equivalence classes of =} = S/= 

defined by t(x) = {z: z = x) . 

The image t(S), i.e., the "quotient" set S/=, is partially ordered by the 
relation R defined by 

T{x)Rr(y) if and only u,v u d t(x) and v £ r(y) and uRv. 

This is the natural homomorphic "contraction" of R to S/=. It can be 
verified that if r{x)Rr{y) and T(y)Rr(x), then t(x) = r(y) strictly. 

If now Y contained in S is such that there exists &y£ Y with yRz for 
every z £ Y, we use the notation 

sup Y (17) 

a 

for r(y). It is clear that in the "quotient" space, an element maximal 
with respect to R is unique if it exists at all. Strictly speaking the notation 

sup tY 

tR 

would be better, since it indicates that the supremum operation only 
makes sense after the homomorphism. However, (17) will be used, with 
the reminder that it is a set, not a state, and the convention that use 
of (17) implies the assumed existence of maximal elements. 

With the notation (17) we can prove the following natural relation- 
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ship between the strong monotone property and the notion of preserva- 
tion of B. 

Theorem 18: Let 

(£ sup A e ,x for e = c 
3 
= x — h for e = h 

and suppose that <p preserves B. Then B has the strong monotone property. 

Proof: xBy implies x ~ y and hence | x \ = \y\,soB has property (14), 
(i) . If xBy, define for z 6 B x 

nz = <p(y(x - z),y). 

Then, since <p preserves B 

<p(y(x - z),x)B<p(y(x - z),y), 

zBfiZ, 

and B has property (14) («*)■ With xBy still, let 

v. A y -+A x 

be given by vz = <p(c,x) for z £ A cy . Then, since <p(c,y)Bw for w £ Acy, 

<p(c,x)B<p(c,y) 

Bz, 

so that B has property (14) (in). 

XVIII. OPTIMAL ROUTING THEOREMS 

This final section contains precise statements showing just how the 
combinatorial properties introduced in Sections XIV and XV answer 
the question: "Which route should an accepted call use? " 

Two policies <p and \J/ will be termed equivalent with respect to rejections, 
written ^? . — ' ^, if they both reject the same calls in the same states, i.e., 
if <p{c,x) = x when and only when \p(c,x) = x for c 6 x. 

Theorem 14: If f preserves B, and if c £ x implies 

(p{c,x) £ sup A cx 

B 

whenever <p(c,x) ^ x, then 

E x (n,<p) ^ E x (n,+) n = 1, 2, • • • . 
for any \p ^ <p. 
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Proof: Ex(X><p) = ExiXiP) by direct calculation. Assume as a hypothesis 
of induction that E x (n,(p) ^ E z (ntf) for x 6 S. We have 

E,(n + 1,*) = E | i * {1 + E pie . x) (n#)} 

•p(c,x)^x 

I X I + AOTx cgx 

¥>(c,x)=x 

+ rrrxi ^ E x ^(n,<p), 

\X\ + Aa x hex 

and a similar expression for E x (n + 1,^). If now <p(c,x) ?* x, then 
(p(c,x)By for every y £ ^c*; in particular, ^(.r,:r) 5^ a- because ip ~ ' ^, 
and so \f/(c,x) £ A cx , whence 

<p(c,x)B\l/(c,x). 

The first isotony theorem and the induction hypothesis now give 
E V (c,x)(n,<p) ^ Et( e ,x)(n,<p) 
^ E He , x) (n,f). 
It follows that 

E x {n+ l,<p) ^E x (n+ l,f). 
Corollary: If <p preserves B, and 

<p(c,x) £ sup A ex 

B 

for c € x not blocked in x, then <p is optimal within the class of policies that 
reject no unblocked calls. 

Theorem 15: If P has the weak monotone property, and 

Slip A ex 
p 

exists for each c £ x not blocked in x, then there exists an optimal policy R 
such that c £ X, y £ A ex imply either x is R-transient or else 

r xy = unless y £ sup A cx ■ 
p 

Proof: Let p be the scalar such that 

r If A i fv = A(R), 

pi = max lim - >, A v < . . /r>x 
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We first use an argument of R. Bellman 10 to show that the vector se- 
quence 

E(n) — np\ = g{n) 

is bounded in n. 

By Lemma 3, there is a vector g* which satisfies 

<7* + pl = mox{v(R) +A(R)g*\ . 

R£C 

Choose K >0 so that 

g* - Kl ^sr(l) ^ g* + Kl. 

Assume, as an induction hypothesis, that 

g* - Kl Sg(n) S/ + JK1. 
We have 

g(n + 1) = -pi + max [v(R) + A(R)g(n)} . 

R£C 

Hence, 

- P l - Kl + max [v(R) + A (R)g*\ ^ g(n + 1) 

R 

^ - pl + Kl + max {»(#) + A(fl)0*} 

g* - Kl ±g(n + l) £ g* + Kl. 

Let now 

g = limsup</(n), 

taken componentwise. Let R n achieve the maximum in 
max\v(R) + A(R)g(n)\ . 

Given c > 0, there exists n such that n > Wo implies 

0z(w) ^ g* + £ 
for all x € 5. Thus, 

e(fl») +A(Rn)g(n) = »(£„) + A(lk)0 + A(R n )[g(n) - g, 
^ v(R n ) + A(R„)g + £ 
g max{v(fl) + A(J2)^} + e. 
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g + P l ^ max [v(R) + A(R)g} . (18) 

R£C 



Hence, since £ > was arbitrary, 

Let 72* achieve the maximum on the right above. By Lemma 3, R* is 
optimal. Let F be the set of transient states relative to R*. The argu- 
ment used in Lemma 4 shows that equality must obtain in (18) on 
S - F, i.e., 



g x -f- p = ma,x\v x {K) -Y l_, a *v 

R£C \ VS.S-P 


{K)g u }, xta- 


t. 




This is equivalent to 








Qx + p = S 1 — i , -, max<^, 1 + max g z \ 

c£x \ X \ + \a x [ ztA ez ) 
c not blocked in x 






| X | + Xa x | X | 


1 \ 2 0*->» 


x£S - 


- F. 


Now the second isotony theorem implies 


j that if xPy, then 






E x (n) ^ E v (n), 


n ^ 1 






g x (n) ^ g v {n), 


n ^ 1 






Qx ^ g y . 








Thus, if c € z is not blocked in x 








max g 2 









is achieved by each and any y € sup A cx . 

p 

Let R be any routing matrix such that for y 6 A ex 
fo if y€S-F, 

rxy = \ 

1 1 only if 1 + 0« ^ 0* and 2/ 6 sup 4 CI . 
N p 

Then ff achieves the maximum in (18), and so is optimal; it is clear that 
it also has the property claimed in the theorem. 
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APPENDIX 

Expected Number of Events to the First Blocked Call 

The purpose of this appendix is to demonstrate that if the index of 
performance is changed to one which attaches greater importance (than 
does Pr{bl}) to blocked calls occurring soon after the system is started, 
then no unblocked call should ever be rejected. This result can be ob- 
tained for various indices of performance; we obtain it for the expected 
number of events occurring until the first blocked call. This choice of 
index of performance has a natural heuristic justification: it corresponds 
to trying to put off the undesirable event (a blocked call) as long as possible. 
(Time is being measured here m discrete units, by counting events.) 

As before we use <p and yp for policies, but here we limit them to rejection 
policies, or policies for the acceptance or rejection of unblocked calls. 
We may think of <p as a binary function of c,x with c £ x and c not 
blocked in x, and interpret <p(c,x) — 1 as acceptance, and <p(c,x) = as 
rejection. A general routing policy, such as described by a fixed routing 
matrix R, will be said to be within <p if it accepts and/or rejects the same 
calls in the same states. 

We first introduce the quantities 

E x ((p) = Expected number of events until the first blocked or 
rejected call under a routing policy optimal within the 
rejection policy <p, starting in .r.f 

These satisfy the equations 

E x (<p) = ' ■ ' ■ , . + j — ■ , , Z, max L M 

| X | -p" \(Xx I X | -+- K<X X cgx V£A CX 

c not blocked in x 
V(c,i) = 1 

| X | + \a x /.gi 

Our object will be to pick the best rejection policy, i.e., to choose <p so 
as to achieve 

max E x ((p)- 

We next define, for each fixed routing matrix R 

E X (R) = Expected number of events until the first blocked or 
rejected call, starting in x and using the policy R. 



t The word 'optimal' here refers, naturally, to the fact that the (not necessarily 
stationary) policy followed makes the expected number of events to the first call 
(rather than Pr'{bl} , or some other index) a maximum. 
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For fixed <p, let R* = R*(<p) = (r x „*) be a routing matrix with the prop- 
erty 

1 if c(i such that y £ A ex , <p(c,x) = 1, 
and E y (<p) = mnxE z (<p), 

r = ■ z £ A cx 

I z<J — j " 

otherwise. 

It is clear that at least one such R* exists, that it is within ip, and that it 
defines a stationary policy for which 

E(R*) = Eitp). 

We now partially order all rejection policies thus: 

<p^\p if and only if ip(c,x) ^ \{/(c,x) for c £ x not blocked in x. 

Let (R be the set of rejection policies. The principal result is that E(-) is 
isolone on the partial ordering ^ of (R, expressed in 

Theorem 16: <p ^ \p implies E (<p) ^ E(\p). 

Proof: For | S | -vectors v define the transformations T v , tp 6 (ft by 

(7»s = ■ ■ £ max fy + r—j-7-r— !>*-*• 

¥>(c,x)-l 
c not blocked in x 

With 

, I .r I + \s(x) 

b * = II , ^ > 

| x | + Aorx 

the equation for .C^) becomes 

E(fp) = 6 4- r^(^). 

It is evident that if v ^ and (p ^ \p, then 

7> ^ 7>. 

Furthermore, each T v ,ip C (R, is a monotone transformation in that 

v ^ w implies T v v ^ T v w. 

Hence, v ^ w ^ 0, <p ^ 4> imply 

6 + 7> ^ b + 7>. 

For 93 ^ \j/, then, consider the rectangular parallelo piped 

(p = {u; g y ^ E(<p)\ . 
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For v 6 (P we have 

Efa) = b + T v E(<p) ^ b + Z>, 

so that 2* : <P -» (P. It is obvious that (P is closed and that ?V is continu- 
ous. Hence, by Brouwer's fixed point theorem there is a V € <P satisfying 

v = b + ?>. 

We next show that v is actually the unique solution of this equation, 
so that v = E(yp) ^ E&). Introduce the norm \\v\\ = max v x . The 

x£8 

case in which the network under study is nonblocking and \p rejects no 
calls is trivial. Assume then that there exists a state x and a call c £ x 
such that either c is blocked in x or c is not blocked in x and is rejected 
by ^. This implies that the "matrix" part of T+ is strictly substochastic, 
and hence that for some n 

II V || < 1. 

Thus, v = E(+). t 

It is an immediate consequence of Theorem 16 that if <p (c,x) = 1 for 
c € x not blocked in a:, then 

E(tp*) = max E(<p). 
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